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We study domain growth dynamics when the target state is suddenly changed on all length scales. 

This procedure mimics the 'chaos' effect postulated by the droplet theory of spin-glasses, and allows 

us to investigate in details its various dynamical consequences. We study the problem by a variety of 

methods, including scaling arguments, analytical solution of the spherical Mattis model, and Monte 

Carlo simulations of a 2-dimensional Ising Mattis model. We show that successive coarsening with 

C*^ ' respect to different equilibrium states imprints multiple domain structures on top of each other, 

q_) , plus extra noise due to random interferences. We demonstrate that the domain structures can be 

[L ■ retrieved by an additional series of coarsening in the reversed order which removes the noises. We 

discuss the rejuvenation (chaos) and memory effects observed in temperature-cycling experiments 

in glassy systems from the present point of view, and discuss some open problems and alternative 

descriptions. 

a 

C/2 ■ I. INTRODUCTION 

Marginal stability of the glassy equilibrium states to weak perturbations such as a small shift of temperatures has 
& ■ been a fundamental interest in the studies of spin-glasses and related systems including vortex lines systems in dirty 
type-II super-conductors. In particular, the droplet picture based on scaling arguments and Migdal-Kadanoff type 
real-space renormalization-group calculations JlrI4j claims that any small but finite perturbation, such as changes 
of temperature by an amount AT, is enough to change the equilibrium states in such glassy systems completely at 
length scales larger than the so called overlap length (at- Such a dramatic effect has been coined temperature chaos. 
It was anticipated that such a change of the equilibrium states, if it exists, should have significant consequences on 
dynamical observable such as the dynamical linear-susceptibility. MM 

From the experimental side, a series of interesting experiments have been done with different spin-glasses measuring 
relaxations of thermo-remanent magnetization (TRM), zero- field cool magnetization (ZFC) and AC-magnetic suscep- 
j^i , tibilities. They show strikingly rich dynamical aspects of spin-glasses subjected to small temperature cycles (within 
iy-s ' the spin-glass phase) j7[-|lq| . The main outcome of the experiments is the coexistence of two seemingly contradictory 
aspects, namely 'rejuvenation' upon cooling and 'memory' upon heating back. These experiments in spin-glasses have 
0^ ' motivated similar experimental studies in other glassy systems including polymer glass [l7|], frozen ferrofluid p8| , 
random ferromagnetic system |19] , random ferroelectric system pQ,El| and structural glass |22| . 

The rejuvenation effect can be interpreted as a signature of the chaotic change of the underlying equilibrium states 
as anticipated by the droplet picture. However the simultaneous memory effect is not obvious to account for within 
the droplet picture, and the previous attempts have remained unsatisfactory |^|||L3|]. The need for some mechanism 
which allows conservation of large scale spatial structures to preserve memory is now clearly realized |14 lqj 
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On the other hand, there has been recent remarkable progress in the dynamical mean-field theory for glassy systems 
[E7J-B1J . It was in particular shown within the mean-field theory [plj that temperature-cycling processes amount to a 
cycling of break-point q^A which separates the stationary and aging part of the correlation and response functions. 
O ■ The cycling of q^A can push a part of the stationary signal into the non-stationary regime (thereby leading to 
rejuvenation), while preserving the rest of the non-stationary part (memory) for large enough time scales. 

A somewhat similar picture was advocated within a hierarchical phase space picture [Q, where each level of the 
hierarchical tree has its own glass temperature. Therefore, a small temperature drop drives a certain level out of 
equilibrium (rejuvenation) while higher level of the tree are frozen (memory) p4|. An important motivation for this 
picture is the Parisi's replica-symmetry breaking solution for the static properties of mean-field spin-glass models. |25| ] 
This scenario has been recently substantiated by interesting numerical simulations |26| . Its real-space transcription 
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in terms of a hierarchy of time scales associated with different length scales was developed in pij , in particular in the 
context of pinned domain walls |19f | . 

In the present paper, we want to go back to the original droplet picture and work out in details the dynamical 
consequences of chaotic changes of the underlying equilibrium state, and in particular address the question of memory- 
conservation. To simplify the approach, we restrict ourselves to the simplest scenario for the relaxational dynamics 
as in |3| . Namely we assume that relaxational dynamics at any temperature is a coarsening process of the domain 
walls between an equilibrium pure state and its time-reversal state. As we noted above, changes of temperature 
amount to complete changes of the equilibrium states beyond (at in the droplet picture. In order to investigate 
the temperature cycling procedures based on the droplet picture, we have studied coarsening subjected to cycling 
of the underlying equilibrium state which we impose by hand. In the present paper, we disregard possible transient 
short-time behaviors associated with length scales smaller than (at and concentrate on the large time phenomena. 
Somewhat unexpectedly, we found that the domain structure corresponding to the different equilibrium states that 
are encountered can indeed be preserved and retrieved dynamically. We will show that the droplet picture itself can 
provide a suggestive and interesting scenario for the rejuvenation and memory effects observed in experiments of 
spin-glasses. 

It is known that changes of temperature in a class of frustrated systems can change the effective couplin g b etween 
certain 'block spins' due subtle entropy effects, so that interesting re-entrant phase transitions can occur [p2| . This 
has motivated a recent work in which somewhat similar ideas for the mechanism of temperature-cycling experiments 
are presented fl33|| . 

The outline of the present paper is as the following. In section fil we briefly review the droplet picture which 
underlies the present study. In section |n] we introduce our models and discuss the generic features of coarsening 
systems subjected to equilibrium states cycling, based on the standard phenomenology of coarsening systems. In 



section IV we study the dynamics of the 0(n) Mattis model in the spherical limit which is described by a Time 
Dependent Ginzburg Landau (TDGL) equation. We solve th e T DGL equation exactly under cycling of equilibrium 
states and examine the physical picture discussed in section III . In section [V] we study 2-dimensional Ising Mattis 



model by Monte Carlo simulations to further check our picture. In section |VI] we compare our results with the 
rejuvenati on ( chaos) and memory effects observed in temperature-cycling experiments in a spin-glass system. Finally, 
in section VII we summarize our result and underline important open questions. In the appendices, we present some 



technical details of the calculations of the 0(n) Mattis model. 

II. THE DROPLET PICTURE 

Here we briefly review the droplet picture which is the background of the present study. For simplicity let us consider 
spin-glasses which have Z^ symmetry like Ising spin-glasses. In the droplet picture, it is assumed that there exist only 
one equilibrium states and its time- reversal state at each temperature below the spin-glass transition temperature T c . 
In equilibrium, the most important contributions to physical observables such as the magnetic susceptibility comes 
from thermally activated excitations of compact clusters of spins, called droplets. 

Let us consider for simplicity the equilibrium state at zero temperature, i.e. the ground state. The total number 
of spins at the surface of a droplet of size L is postulated to scale typically as Lo(L/Lo) ds where d s is the fractal 
dimension of the surface and Lq is a microscopic length scale. By definition, a droplet of size L should have a non-zero 
excitation energy gap. The excitation energy of the droplet E gap typically scales with L as -E gap ~ T (L / Lq) 8 . Here 
T is the stiffness constant and 9 is the stiffness exponent. 

The dynamics of droplets is considered to be a thermally activated process. The energy barrier -Ebarrier to create 
a droplet is supposed to scales with L as -Ebarrier ~ T(X/Zo) with tjj > 6. The relaxation time is given by the 
Arrhenius law, 

t L ^T exp(T(L/L f/k B T), (1) 



where tq is the attempt time for the activated process. 



A. Effect of Temperature Change on Equilibrium States 

In the droplet picture, small temperature changes cause substantial changes of the equilibrium state. The argument 
goes as follows: the entropy associated to a droplet is the sum of contributions which are random in sign over the 
surface of the droplet. The latter implies the entropy associated with a droplet of size L is random in sign, and of 
magnitude ~ kBy/{L/L n ) ds . A subtle conjecture is that the (free-)energy exponent 8 satisfies the inequality 9 < d s /2. 



Therefore, a small change of temperature can ruin the balance between energy and entropy. In particular, the ground 
state becomes unstable at finite temperatures due to the gain in entropy, and is transformed into a 'new' equilibrium 
state that it is completely uncorrelated with the ground state beyond the overlap length, 
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where £ = l/(d s /2 — 9). It is conjectured that this kind of first-order like phase transitions occur continuously within 
the whole temperature range below T c . 



B. Domain Growth 



Within the droplet picture jq] , the aging of spin-glasses that starts from an out-of-equilibrium initial condition is 
thought of as a coarsening process, where the domain walls between the two equilibrium states progressively disappear. 
The coarsening is driven by successive nucleation and annihilation of droplets. From (TO), the typical size of droplet 
which can be thermally activated within a given time scale t is expected to scale as, 
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Thus the mean separation of the domain walls after time t starting from a random initial condition is also expected 
to be given by (|3|). 

While there is no experimental way to observe directly such a domain growth in spin-glasses, AC magnetic suscepti- 
bility can be a useful probe. In the droplet picture, the AC susceptibility at frequency to is considered to be proportional 
to the inverse of the stiffness T of droplet excitations whose size is Lt(w _1 ). During aging, the excitation energy 
gap and hence the effective stiffness is smaller than in complete equilibrium because some droplets of size Lri^J^ 1 ) 
can happen to share their surface with the "frozen-in" droplet of size Lr(t), and lower their energy. Using scaling 
arguments, the resultant reduction of the stiffness is obtained as AT(Lt(^ _1 ), Lr{t)) ~ (Lt(oj~ 1 ) / 'Lr(t)) d ~ e T . From 
the latter, the relaxation of the out-of-phase AC susceptibility is obtained as, 
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where %"(u,oo) is the equilibrium susceptibility. For an experimental analysis of the AC-susceptibility based on this 
scaling ansatz, seej76f. Some related analysis was performed also in numerical simulations of the Edward- Anderson 
spin-glass model [pOJ82|. However, the following analysis will not depend on the detailed shape of (H), but rather on the 
existence of some general (inverse) relation between the AC-susccptibility and the typical size of the non-equilibrium 
droplets. 



C. Separation of Time and Length Scales 



An important consequence of thermally activated dynamics is that it induces a natural hierarchy of time scales (at 
a given temperature) and a strong separation of time scales (between different temperatures) p3fl . The latter is very 
useful to understand the temperature cycling experiments in spin-glasses. Due to the Arrhenius law, the time needed 
to cross a certain energy barrier can be extremely different at two different temperatures, say T and T + AT. The 
time £t needed at temperature T to jump over a barrier crossed at time tr+AT at temperature T + AT is given by: 
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The number of decades separating tr and tx+AT is thus equal to the number of decades separating tr+AT and To times 
AT/T. In experiments, the latter is typically 15 or so, so that a 10% temperature change multiplies the time scales 



by 30. Note that this separation is much weaker in numerical simulations, where the number of decades separating 
tr+AT and tq is ~ 5. 

It is also useful to consider the separation of length scales. Let us consider two temperatures T and T + AT. The 
ratio of the length scale explored at the two temperatures within the same time, say i w , is obtained from (|3|) as, 

L T+ AT(t w ) _( AT\~^ 
M*w) V T J {<) 

One should note that the latter formula does not imply strong separation of length scales: in order to have appreciable 
separation of length scale, AT must be comparable to T itself. 

Finally it should be remarked that the time/length separation is even more sharp in reality because the typical 
en ergy bar riers grow when the temperature is decreased |50| . This can be interpreted as a growth of the stiffness 

T~ J\l-T/T c f". (8) 



III. COARSENING TOWARDS DIFFERENT EQUILIBRIUM STATES 

We now start to consider the possible dynamical consequences of the chaos effect within the droplet picture. Because 
we have in mind the temperature-cycling experiments in spin-glasses, we consider coarsening dynamics under cycling 
of the underlying equilibrium state. In this section we discuss intuitively how and when a succession of coarsening 
with respect to different states can create and store in memory the domain structures of all of them. Some essential 
aspects of the picture will be verified quantitatively in the following sections, based on some analytical and numerical 
study of the Mattis model. 

To be specific, let us consider an Ising spin model on a lattice in which a spin at site i is Si. We denote an 
equilibrium state as a and consider that it consists of a spin-configuration erf where af takes ±1 randomly with zero 
mean. It is convenient to introduce a projection of a spin configuration Si to the equilibrium state erf as, 

~Sf = a«S t . (9) 

Projections to two different ground states say {erf} and {erf} are related as 

sr = oTofsf. (10) 

If a uniform external magnetic field h un i is applied to the system, the Zeeman energy becomes, 

h nni j2Si=j2 n ? § "> ( n ) 

i i 

where we introduce a random field hf denned as, 

hf = h uni cr? . (12) 

In the following, we suppose that the equilibrium state at temperature Ta is a certain configuration a — ±A, and 
at temperature Tg is a different configuration a = ±_B; we suppose that the two states A and B are completely 
uncorrelated beyond the overlap length £at- 

Concerning experiments, it should be noted that temperature is controlled within certain finite resolution ST. Thus 
the overlap length associated with the limited accuracy should be large enough compared with the dynamical length 
scales explored within some laboratory time scales. Otherwise, neither isothermal aging nor 'cycling' can even be 
achieved. 

A. Mattis Model 

It will be useful to study a specific model which allows coarsening towards various equilibrium states in a transparent 
way. In later sections (section IV and [V]) , we analyze in detail the so called Mattis model |56| , 



H({S}) = -JJ2 § ? § ? ~ E W ( 13 ) 

»,.J * 

As one can see easily, this model clearly has the spin-configuration Sf = ±1 as ground states (for h nn \ = 0). Since 
this model is equivalent to ferromagnetic models, the relaxational dynamics at low temperatures is nothing but the 
progressive coarsening of the equilibrium states. p2[ In order to implement the droplet picture more precisely, one 
could introduce some disorder to the coupling parameter J in order to have thermally activated dynamics due to 
pinning of domain walls [ p7[ . The latter does lead to slow growth of the domain as in (@). However, we will not 
perform specific analysis of the decorated model in the present paper. 



In section IV, we study coarsening of the Mattis model in the spherical limit approximation for general spatial 
dimension d, and obtain a fully analytical solution, which we confirm in section |V] by a zero-temperature Monte Carlo 
simulation of the Mattis model in two-dimension [d = 2). 

B. A Cycle on a Symmetry Broken State 

We begin with a simple cycling procedure between Ta and Tq, which provides the basic intuition about the 
coarsening process where the target equilibrium state is cycled. We first grow the B phase with A as the initial 
configuration, and then revert to A as the target state. 

1. Noise Imprinting 

The coarsening towards B given A as the initial configuration is a standard coarsening process, because A is simply 
a random configuration with respect to B: the projection Sf(t — 0) is random in sign with short range correlation 
only up to £at- We focus on how the symmetry-broken state A is affected by this process. 

After time t, the spin-configuration {Si(t)} has coarsened with respect to B: the spatial pattern of the projection 
{Sf(i)} consists of domains of B and —B separated by domain walls. The typical distance between the domain walls 
is L TB (t), and increases with time t. [The growth law L T (t) depend on temperature T in spin-glasses (see (0))-] The 
correlation between the configuration at time t ^> r and the initial configuration is given by: 

C(t, 0) = (1/JV) J2 Si(t)Si(0) ~ (L T (t)/t A T)- X - (14) 

i 

The last equality is a general property of coarsening systems, and defines the non-equilibrium dynamical exponent A. 
p2| Note that we have included the effect of short-range spatial correlations given by £at in the initial condition. 

Now let us consider the projection of the spin-configuration {Si(t)} onto the initial state A. We expect that the 
projection {Sf(t}} are random numbers with only short-ranged spatial correlation. The mean value, however, is 
nothing but the staggered magnetization pA with respect to A which is non-zero. Indeed: 

PA {t) = (l/N)J2§f(t = 0)Sf(t) = C(t,0) ~ (L TB (t)/(,AT)-\ (15) 

i 

where we have used the initial condition {5^(0) = 1}, and the simple identity Si(t)Si(Q) — Sf(t)Sf(0). 

To summarize, if one starts from a completely symmetry broken state A, the coarsening with respect to a different 
state B adds some noise to A, and reduces the magnetization to pA(t) which decreases with t. However it is very 
important to note that for any finite time t the bias is non-zero: the symmetry between A and —A remains broken. 

2. Noise Cleaning 

We now revert back to A as the target state, and evolve the configuration \Sj(t)} obtained above. The initial 
configuration is a random configuration with small bias p = pA(t) given in (|l5|). Obviously the symmetry-broken 
state A should be finally restored, because the bias is present. An important question is the time is needed for the 
recovery. 

If the bias p has been made sufficiently small, the coarsening with respect to A proceeds for a long time almost as if 
the initial condition was un-biased random configuration with short-range correlation of order (at: both the majority 
(A) and minority (—A) phase coarsen. From the initial condition {Si(t)} the correlation behaves as (O) for a long 



time. However, in the large time limit, this correlation has to converge to p since the state A is finally recovered. The 
matching between the two regimes allows one to obtain the recovery time r rec as: 

L TA (r, cc {p))Y\ p 



Cat 

This is the characteristic time around which the symmetry-broken state is almost recovered. 

The fact that coarsening with a biased initial condition dies out after a finite time scale has been analyzed analytically 
in the 0(n) model. |53| The mechanism is similar to the interruption of coarsening under finite magnetic field studied 
analytically in the relaxational dynamics of the spherical Sherrington-Kirkpatrik mean field spin-glass model f54j . 

Now combining ( |15| ) and ( |lq ) , we find a simple relation between the recovery time r roc of a symmetry-broken state 
and coarsening time t with respect to an unrelated phase, 

L Ta (t icc ) ~ L TB (t). (17) 

Note that the role of the overlap-length £at does not appear explicitly. 

Here an important point in spin-glasses is that the time T rec can be extremely different from t due to the strong 
separation of time scales (pi) discussed above: 

■^T B /T A 



r roc = r (-l . (18) 

In the case of negative cycling Ta —* Tb < Ta, the recovery time r rcc can be much shorter than the coarsening time 
t. Conversely, for positive cycling Ta — * Tb > Ta, the recovery time r roc can be much larger than t. 

C. Double Coarsening in One Step Cycling 

We now extend the two stage process discussed above to the following three stage process: we first coarsen the 
system towards A for time i w i starting from a totally random initial configuration, unrelated to both A and B. 
Subsequently, we take B as the target state for a time i W 2, and finally coarsen again towards A for time i W 3. In 
spirit, this corresponds to the one-step temperature-cycling protocol used in experiments f7}p||Ti| . The results of the 
previous section corresponds to the limit where t w i — » oo. 

1. First and Second Stage 

In the first stage, domains of A and —A grow in competition with each other. After time i wl , the mean distance 
between the domain walls is Lt a (£ w i), that we suppose much larger than any microscopic length scale L and the 
overlap- length £at- In Fig- |l| we show a picture of the domain structure of a two-dimensional Ising Mattis model 
(see section [y|) during coarsening. 




FIG. 1. Projection of the spin configuration onto the ground state A at end of the first stage (t = £ w i). The picture is 
obtained by a zero-temperature Monte Carlo simulation of the 2-dimensional Ising Mattis Model. The initial condition is a 
random initial configuration and the duration of the first stage is chosen to be £ w i = 1000 MCS. 

Subsequently the system coarsen towards B. Since the spin configuration obtained by the first stage is a random 
initial configuration with respect to B, coarsening of the domains of B and —B starts from the overlap length £at- 
After time t W 2, the mean separation of the domain walls is £t b (^w2)- (see the upper figure of Fig 0). 




FIG. 2. The spin-configuration of the Ising Mattis Model after the second stage of coarsening towards a state B, completely 
uncorrelated with A (£at = 1). The duration is chosen to be £ W 2 = 20 MCS, much less than £ w i. The upper figure is the 
projection onto B whereas the lower figure is the projection onto A. One can compare the lower figure with Fig. hi and clearly 
distinguish the 'ghost domain' structure. 



An interesting way to monitor the time evolution of the spin configuration during the second stage is to use its 
projection onto A. (see the lower figure of Fig g). Remember that at the end of the first stage, the spin configuration 
is divided into domains of A and —A separated by domain walls at a distance Lx A {t w i) from each other. Let us 
consider such a domain as a window cell to monitor the time evolution of the projection onto A during the second 



stage. Within such a cell, the initial spin configuration is completely polarized with respect either to A or to —A 
Then the subsequen t time evolution of the spin configuration in the bulk of such a cell should be the same as the case 



discussed in section [II B 1. Thus we expect that the projection to A within the cell becomes a random configuration 
beyond (at but with a remnant mean bias whose sign is the same as at time t w \. The amplitude of the bias, however, 
decreases in magnitude as in (|l5|). 

To summarize, after time i W 2 of the second stage, the projection onto A (or —A) is a random configuration beyond 
(at but with a remnant local bias, 

P2~(LT B (t w 2)/UT)- X - (19) 

The remarkable point is that the spatial structure of the sign of the bias, coarse-grained over the length Lt a is the 
same as at the end of the first stage. The 'real' domain walls of size Lx A which separate A and — A at the end 
of the first stage have been destroyed. However, the 'sign' of the bias retains the very same spatial structure. For 
convenience, we call the latter 'ghost' domains. This is the mechanism to install and conserve memory of the thermal 
history of the system in the present picture. 

2. Third Stage 

In the third stage, the state A is restored as the target state, given the final configuration of the second stage as 
the new initial condition. We continue to monitor the spin configuration using the window cell defined above, of size 



Lr A (iwi)- From the discussion in section IIIB2, coarsening of A and — A re-starts within the cell. Let us call this 
regime the inner- coarsening regime. 

How long does this inner-coarsening regime last ? Suppose that the size of the cell Lt a (£ w i ) > which is the typical 
length of the spatial structure of the bias field, can be regarded as large enough so that the situation is essentially 



the same as with an infinitely large system with biased random initial condition (sec III B 1 ) . The inner-coarsening 



finishes at a recovery time related to the strength of the bias as given as (16). However if the size of the cell Lt a (£wi) 
is small the inner-coarsening will be interrupted when the size of the new domains reaches that of the cell. The 
condition separating these two regimes reads: 

a) P2 1/X <£taOwi)/£at- 

b) p^ 1/X » I*t a (*wi)/£at ('finite size effect') (20) 

Thus we obtain the life time r roc of the inner-coarsening regime as, 

( ft \ Tb I Ta \ 

Lt a (ti C c)/£at ~ min(p 2 _1/ , L TA (twi) / £at) or r rcc = min t f — J ,i w i • (21) 

Let us consider the case a) more closely. In this case, a natural expectation is that after time T rec , the magnitude 
of the polarization (bias) within the bulk of the cell is almost fully recovered. The latter implies that the 'ghost' 
domains of sizes L,T A {t w i), which are the trace of the real domain constructed in the first stage, become the 'real' 
domains again. The retrieved domain will then re-start to grow just as the continuation of the 1st stage. We call this 
regime as outer-coarsening regime. 

An important feature is that the domain pattern retrieved after the time T rcc <C twi will remain almost frozen in 



the interval [r rGC ,twi] (See Fig. [II C 2). Thus there is a clear separation between the inner-coarsening regime and 
outer-coarsening regime, when the retrieved domain structure expands appreciably. We call this intermediate regime 
the plateau regime. This is the mechanism which allows retrieval of the memory of the thermal history of the system 
in the present picture. 

Next let us consider the case b). In this case, the noise on the 'ghost domain' is too large and the inner-coarsening 
finishes only at around r rec ~ t w \ . The crossover from inner-coarsening to outer-coarsening takes place very smoothly 
and there is no plateau regime. In this case 'memory' cannot be retrieved because it is impossible to recover the 
amplitude of the bias with its spatial structure frozen: the shape of the domain at around r roc ~ i w i will be already 
different from installed one. 

To summarize, the separation of the inner-coarsening and outer-coarsening regime is different in the case a) and 
b). Combining (|20| ) and (21) we obtain, 



a) Wide separation: L TA (T rcc ) < Lt a {Ui\) 

b) No separation : L Ta (t icc ) ~ L TA {t w i). (22) 



Remember that the amplitude P2 of the bias is related to the duration of the second stage t W 2 through ( |l9| ) . Combining 
the latter with the classification (|22|) we obtain a very simple condition: 



a) Wide separation: 

b) No separation : 



^T B (iw2) <C LT A {twl) 
£>Tb V>w2) ~ LT A (t w i). 



(23) 



Thus the separation between the inner- and outer-coarsening regimes in the third regime depends on relative domain 
size in the first and second stages. 

Finally, let us note for completeness what is happening on the projection onto B during the 3rd stage: the projection 
onto B is becoming more and more noisy but still the 'ghost domains' of size Lr B (i W 2), which is the remnant of the 
'real domains' of B created in the second state, remain. 




FIG. 3. The projection of the spin configuration onto the ground state A in the third stage of coarsening. The snapshot is 
taken after 20 MCS in the 3rd stage. Comparing with Fig. hi and Fig. H, one can find that the 'ghost domains' have become 
the 'real domains' again. The duration of the second stage (20 MCS) is chosen to be much smaller than that of the first stage 
(1000 MCS) so that the plateau regime exists. 



D. AC susceptibility in One Step Cycling 



It is useful to consider how the double coarsening can be observed through the AC susceptibility. Within the 
drop let picture, the relaxation of the AC susceptibility is due to the decrease of the domain wall density (see section 
[IB ). The specific scaling form ([|) is derived for standard isothermal aging where L(t w ) is the size of the domain 
monotonically increasing with time. In the case of the one step cycling, we only need to replace L(t w ) by the relevant 
domain size. 

In the first stage (0 < t < t w i) , the susceptibility simply decays as standard aging (0) where the relevant size of the 
domain is that of the A phase Lt a (i). In the second stage (£ w i < t < t w \ + t W 2), the relevant domains are that of the 
B phase so the relevant length scale is now Lt b (t — t w i). Thus the relaxation re-starts and there is a discontinuity at 
t = i w i) as clearly observed in many experiments, mp 12 

In the previous section, we argued that the third stage (i w i + £ W 2 < t) can be divided into two asymptotic regimes, 
namely, an inner-coarsening regime for (t w i + t W 2 < t <C i w i + t W 2 + t icc ) and an outer-coarsening regime for 

(twl + t w 2 + T re c ^C t). 

In the inner-coarsening regime, the relevant size of domain is Lt a {1 — twi — ^w2)- Thus the relaxation of the AC- 
susceptibility re-starts and there is again a discontinuity at t — t w i + t W 2 • This feature can be observed only if the 
frequency w of the AC field is large enough compared with the inverse lifetime of the inner-coarsening regime, 



ui 1 <C r rc 



(24) 



On the other hand, in the outer-coarsening regime the relevant domain is that of the revived ghost domains. Thus 
in the latter regime, the relevant size of the domain is simply Lt a (t — i W 2) and the relaxation of the AC-susceptibility 
is the continuation of the first stage as if the second stage were absent. This can be observed if the experiment is 
continued up to large enough time i W 3 compared with the lifetime of the inner-coarsening regime, 



^w3 > r rc 



(25) 



yy 



X (co;0 
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t 

FIG. 4. Schematic behavior of the relaxation of the out-of-phase AC-susceptibility in an one-step cycling procedure. The 
thick dotted line is the reference curve which is the direct continuation of the first stage. 'A' and 'B' indicate which equilibrium 
state is coarsening. 

We summarize the generic behavior of the relaxation of the out-of-phase AC-susceptibility in the one-step cycling 
procedure in Fig. |j. Here a very important remark is that the strong separation of time scale (||) in spin-glasses due 
to the activated dynamics can explain the strong differences in the third regime between negative and positive cycling 
observed in experiment (this point was emphasized in J13|,p[). In the case of negative cycling, the outer-coarsening 
regime can be easily observed but the lifetime of the inner-coarsening regime can be so short that (£4|) is not satisfied. 
On the contrary, positive cycling makes the inner-coarsening regime easily observed (rejuvenation) but its effect is 
rapidly too large to allow the observation of some 'memory'. As we will discuss later in section |Vl| the experimental 
data can be (at least qualitatively) interpreted along these lines. 

E. Relaxation of DC susceptibilities after One-Step Cycling 

Another powerful experimental tool to study the temperature-cycling process is the DC-magnetic susceptibilities 
in the third stage of the one-step cycling. In a class of experiments MJ, very small magnetic field h is applied during 
temperature-cycling Ti(£ w i) — v T 2 (t W 2) — > Ti(t w3 ). The magnetic field is then cut-off at time 



j.total __ i 
s w — ^w3 



i W 2 + iwi 



(26) 



and relaxation of the magnetization (thermo-remanent magnetization (TRM)) is measured subsequently at time 
r + i^? tal with increasing r in the third stage where the temperature is kept to T\ . 

As far as linear-response holds, the magnetization can be written as /iytrm(t + ^w ta \ *w tal ) where we introduced a 
dynamical DC-magnetic susceptibility. In another class of experiments |L3], the temperature cycling is done under zero- 
field. Then a small magnetic field is switched on and the growth of the magnetization (zero-field cooled magnetization 
(ZFC)) is measured. Again the magnetization can be written as hxzFc( T + tw tal > C' 11 ) where we introduced another 
dynamical DC-magnetic susceptibility. As far as linear response holds, the TRM and ZFC are simply related |12J as 



XZFC(T + £ W ,t w ) 



Xtrm(t + C ta \ C al ) = Xzfc(t + 4 ota \ 0). 



(27) 
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The rightside of the last equation is the magnetization (divided by h) measured if the magnetic field is applied from the 
beginning and afterwards. Experimentally such a magnetization almost saturates to a constant which is oftenly called 
as field cool (FC) magnetization. If one assumes naively that the fluctuation dissipation theorem (FDT) holds, the 
DC-susceptibilities (per spin) are related to auto correlation function C(t + £^ tal ,£^ >tal ) =< m{r + £^ >tal )m(£^ )tal ) > 
of magnetization m(£) (per spin). Assuming that the correlation function is normalized as C(£,£) = 1 one finds the 
ZFC susceptibility as, 

Xzfc(t + C ta \ C tal ) = (fcBT)- !(1 - C(r + 4° ta \ t^ 1 )). (28) 

and the TRM susceptibility xtrm(t + 4° tal ,4° tal ) is related via (§7J). 

Let us now consider the one-step cycling protocol. Suppose that the magnetic field is applied during the 1st and 
2nd stage and then cut-off right at the beginning of the third stage, i.e. £ W 3 = so that £^ tal = £ W 2 +t w i- Then TRM 
magnetization at time r + £^ tal = r+ (£ W 2 +£ w i) should relax with increasing r just like the auto-correlation function 
between the magnetization right at time £ W 2 + £ w i and that after time r later. From the discussions in the previous 
sections, we expect that auto-correlation function will be generically the following, 

C(t + (£ w2 + £ w i), £w2 + £ w i) = C (r, 0) L(t) < L(r rcc (p)) inner-coarsening (29) 

/oCo(r + £ w i,£ w i) L(t) > L(T roc (p)) outer-coarsening, (30) 



where Co is the auto-correlation function in the standard coarsening ( |14[ ) and p is the amplitude of the ghost domain 
right after the 2nd stage, which decreases for lar ger £ w 2 . We have confirmed the above feature analytically within 
the spherical Mattis model (see Fig|]) in section IV E and numerically in two-dimensional Ising Mattis model (see 



Fig.|9j) in section M, I t is interesting to note that quite similar features have also been obtained within the dynamical 
mean-field theorypTJ in the sense that the effect of the second stage amounts to a reduction of the plateau value gEA 
at which the rejuvenation and memory effects are separated. 

Here we are assuming the case a) L(£ w i) 3> L{t W 2) which allows clear separation between the inner- and outer- 
coarsening regimes. The initial decay is that due to the inner-coarsening regime, (L(t) <C L(t icc )) where the correlation 
decays as if the memory of the first stage was completely lost. The remarkable feature is the plateau regime L(t tcc ) <C 
L(t) <C L(£ w i), where the correlation function stays almost constant. The subsequent drop is due to the outer 
coarsening L(£ w i) <C L(t) where the correlation function decays as if the second stage is absent. But here the amplitude 
is reduced from 1 to p. Note that in the limit L(t w \) — ► oo, the second relaxation does not occur Cq(t + £ w i, £ w i) = 1. 



The latter is the same as the case of a cycling on a symmetry broken state discussed in section IIIB2. 

In the previous TRM experiments 0, the field change is made not right at the beginning of the third stage but 
slightly afterwards when some additional time £ W 3 is spent in the third stage. The auto correlation corresponding to 
the DC-magnetic susceptibilities is now C(t + £^ tal ,£^ tal (= £ w3 + £ w2 + £ w i)) with non-zero £ W 3 > 0. The behavior 
becomes more complicated because the noise is already removed to a certain extent during the additional period 
£ W 3 thus the effect of rej uvenation tends to be obscured. Nonetheless we explicitly compute such an auto-correlation 



function in section IV E and later compare with experimental curves in section VI . 

Finally let us note that standard FDT assumed above naively does not hold in non-stationary dynamics as the one 
we are concerned here. It is by now well known 27 2f]]3(J that in spin-glass systems one should consider modified 



forms of FDT. As compared with the AC-susceptibility discussed in the previous section, DC-susceptibilities contain 
integral contributions of wider range of the non-stationary parts of the response function where the standard FDT 
is very likely violated. Unfortunately, the conventional droplet picture MM is not able to take into account strongly 
non-stationary part of responses in spin-glasses. Recent progress of the dynamical mean-field theories p7|-p9[| suggests 
that it can be quite different from usual coarsening systems. Nonetheless, qualitative features of relaxation curves of 
auto-correlation functions and DC-magnetic susceptibilities, such as the waiting time effects, arc known to appear 
very similar in the case of isothermal aging. The latter implies that qualitative feature discussed above concerning 
the relaxation after temperature-cycling also applies for the DC-magnetic susceptibilities. 

F. Multiple Coarsening in Multiple Step Cycling 

One can naturally extend the one step cycling to multiple steps cycling of the equilibrium states trying to mimic 
continuous temperature-cycling experiments p^,[Tq]. For example, let us consider the coarsening of three different 
equilibrium states A, B and C which take place in turn as A — > B — ► C with durations £ w i, £ w2 and £ W 3 respectively. 
Since we are interested with large time behaviors, we disregard the differences between the corresponding overlap 
lengths and simply set them to the microscopic length Lq. At the beginning of each stage, a new coarsening process is 
started. After the first, second and third stages, the domain sizes of A, B and C are Lr A (twi), £t b (£ W 2) and £t c (£ W 3) 
respectively. 
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Let us consider the noise imprinted on the projected configuration (onto the reference state) due to the 
coarsening of unrelated phases. The second stage reduces intensity of the bias of the A phase from 1 down 
to pA{twi + t w %) ~ {LT B (tw2)/Lo)~ X - Similarly, the third stage reduces the bias of the B phase down to, 
Pb(£w1 + t w2 + iw3) ~ (Lt c (tvf3)/Lo)~ x . An interesting question is how the third stage influences the projection 
onto the A phase. A natural expectation is that the noise effect is multiplicative n, 

pA{t w3 + t w2 +twi) ~ p A (t w i+t w2 ) x (L Tc (t w3 )/L )- x ~ (L TB (t w2 )/L )- x (LT c (t W 3)/L )- x . (31) 

To summarize, we obtain a 'real' domain of phase C with size Lt c (t W 3) and 'ghost' domains of phases A and B, with 
sizes Lr A (£ w i) and LT B (t w2 ) respectively but with reduced intensities. Thus the information of all the three phases 
are now stored in the spin configuration but with noises due to random interferences. 

Now let us consider how we can retrieve memories installed above by removing the noise that blurred stored 
information. Here we have to remember that memory can be retrieved by additional conjugate coarsening but only 
in the case a): when the noise is small enough (see (|20|)-(|23|)). 

To be specific, let us suppose that the previous coarsening of A, B, and C is done in a well separated manner in 
the sense that t wi ^> T (t w2 / 't ) T£! I Ta and t w2 ^> T (t w3 /To) Tc ^ TB ■ Then let us consider reversed order coarsening 
of the above procedure. First, we perform coarsening of B with durations t' w2 given the final spin configuration 
obtained above. According to the result of the previous section, it is sufficient to choose the duration t' w2 ~ T lec = 
7"o(£w3/to) Tc / Tb to remove the noise on B due to C and recover the spin configuration just before the coarsening of 
C. We will not choose a larger t' w2 in order to avoid the outer-coarsening of B which adds some additional noise to 
A, which will be treated later. Second we perform coarsening of A. By the same argument, it will be again enough 
to choose its duration as t' wl ~ r roc = T (t w2 /TQ) TB ^ TA . 

If one skips the 2nd coarsening of B and try to remove the noise by doing only the 2nd coarsening of A, the time 
need for the recovery r rcc will become astronomically large, 

(L(r rcc )/L )- X = p A xp B or r rec = ^(^/^J^/^^/^MW^) (32 ) 

Thus it is very important that the multiplicative noise is cured in two steps and not by a single stroke. 

More generally one can perform successive coarsening of arbitrary number of phases A\ — > A 2 . . . — > A n with 
durations t w2 , t wS , . . ., t n followed by the reversed processes A„_i — * A n - 2 . . . — ► A\ with durations t' n _ 1 , t' n _ 2 , . . ., 
t[. The retrieval of the memory of each phase is ensured by the condition, 

ti » To(t i+1 /Tof i+l/Ti t'i~ti. (33) 

Not that is can be easily realized in negative cycling. The domain structures of all the phases will be retrieved 
one after another, [j The behavior of the AC-susceptibility during such a multi-step (continuous) cycling will be 
interesting. The generic behavior will be 'hierarchical' as depicted schematically in Fig. |[ In section VI, we discuss 
recent continuous temperature-cycling experiments from this point of view. 



1 We explicitly verify this relation within the 0(n) Mattis model in appendix H. 

2 The phases of large i which are recovered earlier become noisy again as phases of smaller i are treated later. 
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FIG. 5. Schematic behavior of the relaxation of the out-of-phase AC-susceptibility in a two-step cycling procedure. Thick 
dotted lines are the reference curves which show direct continuation of the second and first stages. 'A', 'B' and 'C indicate the 
equilibrium states which are coarsening. 



IV. THE 0(N) MATTIS MODEL 



In the previous section we discussed the peculiar properties of coarsening under a cycling of the equilib rium states, 
based on scaling and heuristic arguments. In this section we study the Mattis model introduced in section [II A in the 
spherical limit. This allows us to explicitly solve the dynamical equation under one-step cycling of the equilibrium 
states and check in details the physical picture presented in the above sections. This section is rather technical and 
can be skipped at first reading (the previous section is indeed the summary of the study in the present section and 
section [V]) . The reader interested by a more physical discussion can go directly to section VI . 



A. Model and Definitions 



1. Dynamics of Projection Field 



Here we generalize the projection field S to be a n-dimensional vector field <f>(x, t) continuously varying in a d- 
dimensional space. The time evolution of the projection field 4>{x, t) is given by the time dependent Ginzburg-Landau 
(TDGL) equation, 



with the free-energy functional defined as, 



F 



[4>] 



d d x 



d(f> SFty] 
dt 5cj> ' 




1 ,„ ,\9 ( n 

-(V</>) 2 + «^- 


-\<p\ 2 ) 2 ] 

4n 



(34) 



(35) 



Here we disregard the Langevin force due the to thermal noise on the dynamics because the latter is irrelevant in the 
present model ]52| ]. 

In the spherical limit n — > oo, under the assumption of self-averageness, any one of the component satisfies, 



01 



V 2 ct>-z{t)cj>, 



(36) 



with 
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z{t) = n(l (0 2 (t))), (37) 

where (...) means expectation value. Thus we only need to consider a single component, i.e. a scalar field in the 
following. 

2. Random Equilibrium States 

We suppose that the equilibrium configuration is represented by a random scalar field <j(x). The spin configuration 
ip(x) is related to the projection field as, 

ip(x) = a(x)<f>(x), (38) 

which is equivalent to the relation (0) on the lattice. We assume that a(x) is a Gaussian random scalar field with 
zero mean, 

(o(x))a = (39) 

and short-ranged spatial correlations, 

(a(x)a(x')) <J = A6 d (x-x'). (40) 

The latter means that we essentially disregard the finiteness of the overlap length (g). One could include this effect 
by introducing a short-range correlated Gaussian field. However since we are focusing on large time behavior, we do 
not go into such details in the present paper. 



As for the lattice case (|10|), the projections to different equilibrium states, say a and j3, are related as, 

cj> a (x)=a a0 (x)(f> (x). (41) 

where we defined a 'transformation field', 

a a0 {x) = a a (x)a' 3 (x). (42) 

The transformation field should be also a random field with zero mean, 

{a a0 {x)) a = (43) 

and short-ranged correlation, 

(a a,3 (x)a af3 (x')) a = AS d (x - x'). (44) 

More generally we have, 

(a a ^ (xi)a a * a * (s 2 ) . . . a Q - lQ » (x n -!)a a " ai {x n )) a 

= A n 8 d ( Xl ~ x 2 )S d (x 2 -x 3 )... 8 d {x n . l - x n ). (45) 

Some useful statistical properties of the transformation field are presented in appendix H. 

3. Formal Solution 

Taking Fourier transform 4>k = J d d X(j>(x)e lkx , one finds the formal solution to the TDGL equation ( |36| ) as, 

e -k 2 {t-t') 
^ k (t)=Mt')—===, (46) 

V 1 I*'* > 



where we introduced 



T(t,t') = exp [2 / dt'z(t'U . (47) 
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Note that details of the solution are absorbed in T(t,t'). By definition one must have the identity, 

r(i,t) = i. (48) 

To simplify our calculation, we consider a — > oo to enforce the normalization of the magnitude of spin at any 
position in space and time: (f> 2 (x,t) = 1. ]6q| In Fourier space, the latter implies that the formal solution can be 
written as, 

$ k (t)$l(t) = (2n) 2d 5 d (k + l)W k (t), (49) 

Here Wk(t) should satisfy, 

d d k W k {t) = 1. (50) 

Note that W k {t) is the structure-factor of the projection field. The factor T(t, if) (or equivalently z(t) ) can be 
determined self-consistently so as to satisfy the normalization condition <fi(x, t) 2 = 1, 

r(i ' t0 =/ (^(^ e " fca(t "° e " ,a(t "°^(* , ^ | (*'^ = J d d ke- 2k2 ^W k (t>). (51) 

Then the structure-factor (H9) at time t is obtained formally as 

— 2k 2 (t — t r ) 

W k (t)=W k (t' f . (52) 



4- Physical Observables 

The properties of coarsening systems can be well characterized using correlation functions. Given a structure- factor 
(E3) at a certain time s, the auto-correlation function for two times t > if > s can be formally computed as, 

C(r,t,t') = (4>{r,t)<t>{Q,t')) = / d d k k[) . (53) 

In particular, the equal-time if = t spatial correlation function is obtained simple as the inverse Fourier transform in 
space of the structure factor W k (t), 

C(r,t,t) = f d d ke lkr W k (t). (54) 

Another important quantity is the local auto-correlation function, 

C(r = 0,t,t')= m+n/M . (55) 

In the following we denote the (local) auto-correlation function C(r — 0, t, t') as C(i, t') for simplicity. Since coarsening 
is a non-stationary dynamics, the correlation functions depend not only on the time difference t — t w but explicitly 
on the two times t and t w . This feature is called 'waiting time effect' or 'violation of time translational invariance'. 

In addition to the correlation functions, linear-response functions are also very interesting to study. In the spin-glass 
experiments, the measurement of the linear-response such as AC magnetic susceptibility is one of the only detailed 
probe for the dynamics. In appendix O we present the formal solution for the linear-response function of the 0(n) 
Mattis model to uniform external field. 
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B. Standard Coarsening 

Before studying coarsening under cycling of equilibrium states, let us review essential results in the case of standard 
coarsening, i. e. coarsening with un-biased random configuration with short-range correlation. The solution is well 
known and studied in detail. p2J 

Let us choose the random initial condition as, 

($ k ^) ini ^A(27r) d S d (k + l), (56) 

which is equivalent to 

(<f ) (x)<f ) (x')) ini = A5 d (x-x'). (57) 

The latter means the structure-factor (|4^) is flat (white noise) at the beginning, 

^(0) = ^- (58) 

Then the solution is obtained using ( pl| ) as, 

ro(*,0) = j^Jd d ke- 2k2t = (±) ~ (L(t)/L )- 2 \ (59) 

where we defined a microscopic time scale To = A 2 / d /(87r). Note that this expression is valid for large enough time 
separation t compared with tq. In the limit t — we must have the identity (^8|). For the definition of L(t) and the 
exponent A in the last equation see (|6l]) and the following. 

The correlation functions can be obtained using < p4\ ) , ( p5| ) and ( J58| ) . The spatial correlation function at equal-time 
becomes, 

A f . e - 2k2t e ikr 



C (r,t,t) = (<Kr,t)<f>(0,t)) = —-j / d d k 



(2ir) d J r (t,0) 



,.2 



°- x iM -^ I «'M> 



2 

r 



L(t) 



(60) 



In the last equation we introduced a characteristic length scale, 

L(t) oc L Vt, (61) 

where Lq is some microscopic unit of length. Although there are no topological defects like domain walls in the 
spherical limit n — ► oo, the latter characteristic length scale plays the role of scaling variable as played by the mean 
separation of domain walls in the systems with domain walls p2[ . 

The correlation between the random initial configuration and the temporary configuration at time t is obtained as 

C (*,0) = (^(t)^(0)) = ^§ = 2 d/2 (i/To)- d/4 - (iW/io)- A . (62) 



The non-equilibrium dynamical exponent A (see (14)) of the O(n) model is known to be, 

A = d/2 0(n -> oo) model, (63) 

as one can see easily comparing with (pi]). More generally the two-time auto-correlation functions is obtained as, 

Co(Mw) - (^W(*w)) - ^tww/L ~*>*- (^W/i(iw))- A . (64) 

yl (t,U)yl (t w , UJ 

Here the waiting time effect follows the L(i)/L(t w ) type scaling behavior as in many other coarsening systems. [p2[ 
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C. A Cycle on a Symmetry Broken State 



Let us now begi n to an alyze the effect of cycling the equilibrium states on coarsening with the simplest version 
described in section III B 1 . Here we look at how the projection of the temporary spin-configuration onto an equilibrium 
state is progressively affected by the coarsening of a completely unrelated phase. Subsequently we study in detail how 
the noise induced by this process can be removed progressively by performing the 'conjugate' coarsening. 



1. Noise Imprinting 



Let us take a random ground state {of } as the initial condition so that the symmetry is fully broken with respect 
to a at the beginning, 



fc (O) = (27r)-^(fc) 



(65) 



We then perform coarsening with respect to a completely unrelated ground state {erf}. The initial condition should 
look as a completely random configuration in the projection onto /3. Due to (Al) which is the Fourier transform of 
(pq) we find, 



^(0) 



d d k' 

W) 



■(o a P) k/ (2Tr) d 5 d (k + k') = (o a P) k , 



(66) 



Here (a a>3 )k is the transformation field defined in ( [A2] ) which is a Gaussian random field (see appendix |A|). By (A3) 
and (A4), one can check that the initial condition for the coarsening with respect to /3 is indeed a random initial 
condition with zero mean and short range correlation as it should. The solution of the equation of motion with such 
random initial condition is known as shown in (p9|) . 

Let us monitor the time evolution of the spin-configuration by projecting onto a through (|A1 



mt) 



d d k' 

(2n) d 



(^)k'^-At)- 



(67) 



Using the 2-body correlation function of (a a/3 )k shown in (A4), one finds that the resultant configuration have the 
following properties. 

First, it is easy to see that the k = component of the projection onto a has non-zero mean while the others have 
zero mean, 



with 



(&(*))„ - (27T) d S d (k) p 

(r(x,t)) a =p 
p = C o (t,0)~(L(t)/L o )- > 



(68) 



(69) 



(70) 



The result means that the symmetry remains broken with a weaker and weaker bias p as the coarsening time t with 
respect the unrelated phase (3 increase. This feature has been discussed in section IIIB1 (see (flq)). 

Second, the spatial correlation of the projection to a can also be obtained as described in appendix |B|. The 
initial condition ( pq ) implies that initial structure-factor is Wf?(0) = S d (k) in (49). Then from (B12), we obtain the 
correlation function as, 



with the structure-factor, 



{<l> a k (t)4>?(t))a = (2TrY d 5 d (k + i)wm 



W£(t) = p 2 S d (k) + ^A_(l - 2p 2 + e- k2 ^) 



(71) 



(72) 
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By taking the inverse Fourier transform one finds, [j 

(r(x,t)<f> a (x',t)) a - (r(x,t)) a (r(x',t)) a 

= Ad d (x - x')[l - 2p 2 } + e-(»-«')/3t^2. (73) 

To summarize, coarsening of unrelated phase produces essentially short-ranged correlated random field with weak 



bias as we expected in section III B 1 



2. Noise Cleaning 

Let us stop the coarsening of the unrelated phase p at time t = t W 2 and see closely how the noise imprinted on 
the projection field to a are removed by coarsening with respect to a for some additional time £ w3 . Given </> a (a;,£ w2 ) 
obtained in the last stage as the initial condition for this stage, the solution at time £ w3 + £ w2 is obtained as 

02(tw8 + *w 2 ) = k(t w 2) ■= e ==^= = ■ ■ (74) 

V 1 cycle \tw3 + *w2 > *w2 j 

Here the factor r cyc i c (i w3 + t w2l t w2 ) is obtained using (^l|), (^2|) and (]5g) as, 

r cy cic(tw3 + *w2, *w2) = p 2 + (i - 2 P 2 )r (i w3 , o) + r (< w3 + t w2 /4, o), (75) 

with 

P = C (i w2 ,0)~(L(t w2 )/i )- A . (76) 

Here To is the one obtained in the solution for standard coarsening ( p9|) with un-biased random initial condition. 

For the following analysis, it is useful to introduce the relative ratios of the three terms in (f75|), which will find a 
natural interpretation later: 

m mcm('w3i'w2) = P /F C ycle(£w3 +^w2,iw2), (77) 

W rc j(t w 3,t w2 ) = (1 — 2p )ro(t w 3j0)/r cyc i e (i w3 + f w 2, fw2j, (78) 

*n (iw3)^w2j = To(*w3 + *w2/4, 0)/r cyclc (i w3 + t w 2,t w 2)- (79) 

By definition the sum of the three is always 1. 

Suppose that i w2 has been chosen to sufficiently large. Then for small enough i w3 compared with t w2 , m re j is 
dominant, 

TOj^j ~ f Or r cyc lc(iw3 +£w2,£w2) — r (t w3 ,0) — (L(t w3 )/L )~ 2X . t w3 < r TOC (80) 

~2 



here we used (p9|). On the other hand, at large enough time t w3 , rri re j and rh go to zero, 



,2 



m„ 



1 or r cyc i c (i w3 + t w2 ,i w2 ) ~ p i w3 3> T rec . (81) 



The crossover between the two limits takes place when the ratio m 2 : and rn 2 aom becomes of the same order, (we are 
assuming rh 2 <C m 2 c -\ Then using (p9) one finds the crossover time T rcc (p) as, 



p ~ (L(r rec (p))/L )- A . (82) 

The above feature has direct consequences on the physical observables. 

First, let us consider the density of staggered magnetization. Using (pq), it is obtained simply as, 



3 In the derivation of the last equation we used T(t/4, 0) = C 2 (t, 0) = p 2 as one can check from (B2I) and (p9[). 

4 One can check that r(£ W 2,i W 2) = 1 is satisfied since r(£ W 2/4) = C 2 (£ W 2,0) = p 2 as one can check and To(0, 0) = 1 because of 



the identity Qm 
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<0 Q (*w3+*w2)) ff 



d d k 



-k J U 



(2n) \/r cyc i e (i W 3 + t w2 , t w2 ) 



fa* (***)>« 



^mcra v w3 5 ^w2 J ■ 



(83) 



V r c yclo(^w3 + t w 2, t w2 ) 

In the last equation we used the definition of m^ lom (t W 3, t W 2) given in (|77J). Thus m mem (^w3, iw2) is the staggered 
magnetization in the bulk, that will contribute to the memory effect. The staggered magnetization starts from p and 
saturates to the full moment 1 at time scales large enough compared with r rec (p) defined in (p3). It means that the 
density of the minority phase shrinks and the fully symmetry broken state is almost recovered within a finite time 
scale. 

Second, let us consider the equal time spatial correlation function of fluctuation of the projected field around the 
mean {cj> a (t w3 +*w2)) CT , 



Using 



H a (r, t w3 + t w2 ) = <j> a (r, i w3 + t w2 ) - (0 Q (t w3 +t w2 )) a . 
(||), © and (f7§) and (f|) it is obtained as, 



(84) 



b a {r,t w3 + t 



w2j 



m 2 ei (t w3 ,t w2 )exp 



' Q (0,t w3 + t w2 )) CT = J d d k 

.2 

+ "i 2 (^w3,*w2)exp 



{2ir) d 



1-2// 



3 -fc 2 tw2/2 



-2fc^i„ 



rcyclc(^w3 + tw2i t w 2) 



8f v , 



8(t w3 + W4) 



(85) 



In the last equation we used the parameters defined in ( |78| ) and ( J79[ ) . This result should be compared with the case of 
coarsening with un-biased initial condition (pfl) . For simplicity we assume that t w2 has been taken very large so that 
the second term can be neglected. Then one finds that at short enough time scale the amplitude of the correlation 
function stays constant m 2 a - ~ 1 because of (pCJ). In this regime the behavior of the correlation function is essentially 
the same as in the usual case of coarsening with un-biased initial condition (pfl); this contribution will therefore be 
associated to rejuvenation. The range of correlation grows as, 



i(*w 3 ) 



*w3 <^ T re 



(86) 



At larger time scale compared with r rec , the amplitude m 2 - vanishes because of (81) and the fluctuation disappears, 



t> a (r, t w3 + t w2 )Scj) a (0, t w3 + t w2 )) CT ~ exp 

:ompared a 
i.e. the system is ordered again 

(^ a (r,t w3 +t w2 )^ a (0,t w3 +tw2)> CT ^0 t w3 >T roc . (87) 

Finally let us consider the auto-correlation functions. The simplest one which is useful is the correlation between 
the configuration at the beginning of the final coarsening with that at some later time. One easily obtains, 

rcyclo(^w3/2 + t w2 , t w2 ) 



V r c ycle(^w3 + ^w2) t w2 ) 



C(tw3 + i w 2jiw2) 



This result should be compared with the case with zero bias (p2) . One can easily see that at the beginning i w3 <C T rcc 
where r cyc i c (t w3 + t w2 ,t w2 ) ~ Fo(i w3 ,0) ( |80| ) holds, the correlation function decreases as if starting from random 
initial conditions without bias, 



C{t w3 +t w2 ,t w2 ) ~ Co(t w3 ,0) ~ (L(t w3 )/Lo) 



^w3 ^^ ^"rc 



On the other hand it saturates at large enough time scales due to r cyc i e (i W 3 + t w2: t w2 ) ~ p 2 , see (|8l|), as 

C(t w3 + i w2 , t w2 ) = p t w3 ^> t 1cc . 



(89) 
(90) 



In section [II B 1 , we expected this feature on general grounds and used it to estimate the recovery time (fiM . 



D. Double Coarsening in One Step Cycling 



Now we analyze the double coarsening process discussed in section III C in the present specific model. We first let 
the system coarsen towards the equilibrium state a for time i w i starting from a random initial condition (pq). Then 
we change the target state to (3 for a time t w2 , given the configuration obtained above as the initial configuration. And 
finally, we switch back the coarsening towards the original equilibrium state a for time t w3 . Note that the process we 
considered in the previous subsection can be regarded as the special case of t w i = oo. 
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1. The First and Second Coarsening 

The first stage is the usual coarsening from random initial conditions. The structure- fact or of the projection field 
with respect to a after time t w \ is given in ( p8|) which reads as, 

A -2fc 2 t wl 

WZiUl) = (l) , dr ,, n y (91) 



As we discuss in ap pendix M, the projection of this configuration onto (3 is random with zero mean (|B7|) and short 



range correlation (B8). Thus a new coarsening process begins in the second stage. After time t w2 , the correlation 



with the configuration at time t w \ is, 

P = C(t w2 ,0)~(L(t w2 )/L )-\ (92) 

In the following we analyze the time evolution of the coarsening in the second stage (towards (3) by projecting onto 
a. The basic information is the structure-factor of the projection field with respect to a which can be obtained using 



(Bll) and m 



W£(t w2 + t wl ) = p 2 W£(t wl ) + — - d [1 - 2p 2 



d d k' / d d r e -( fc - fc ') 2t - 2 e-( fc+r ) 2 '-w fe Q _ fc , +; (i wl ) 



A 
(27) 
1 A 

+ r (£ w2 ,0)(27r) d 

2 A e - 2fc2 ^ A 2 

- P (27r)^r (t wl ,0) + (27r)^ (1 2p) 

2 A CXp (-2fc 2 £ w l/,4ftwlAw2)) 

+ P (2iT^A{t^/t^)) d r (twi,o) ' 

where 

A(y) = 1 + Ay. (94) 

The spatial correlation function of the projection with respect to a is obtained immediately using (B3h in (&3) as, 

C(r,t w2 + t wl ,t w2 + t wl ) = p 2 exp (-^—) + (1 - 2p 2 )AS d (r) 



+ p 2 A- d / 2 (t wl /t w2 )exp (--— 



/A(t w \/t vj2 ) 



(95) 



This simple result immediately allows its physical interpretation. The first term in (Bq) can be written as 
p 2 exp(— (r/L(i w i)) 2 ) which implies the remnant of the spatial correlation established in the first stage. The am- 
plitude p decreases as (|92|) in the second stage. This can be interpreted as the correlation between the 'ghost' domains 
discussed in section |IIICf which is losing its amplitude. Thus no matter how large the noise becomes, the 'memory' 
of the spatial structure is conserved. The second term (pq) represent the short-range noise induced by the coarsening 
of an unrelated phase. The last term becomes the same as the first term in the limit L(t w2 ) 3> L(t w i) since A ~ 1 as 
one can see from (M). In the other limit, L(t w i) ^ L(t w2 ), it can be neglected. 

2. Inner- and Outer- Coarsening regimes in the Third Stage 
We now restore the equilibrium state a as the target state for time £ W 3 given the 'noisy' spin-c onfiguration at 



the end of the second stage as the input. Here we examine the scenario conjectured in section IIIC that the inner- 
coarsening transforms the 'ghost domains' back into 'real domains'. We demonstrate that the inner-coarsening regime, 
the intermediate plateau regime and the outer-coarsening regime show up explicitly in various correlation functions 
and response functions. 

Using ( P3[ ) in (J5l|), the T factor in the third stage which we detnoe as ri_ stop is obtained as, 
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rVstc P (*w3 + t w2 + twi.twa + twi) = / d d ke-^ ^ 3 W^(t w2 + t wl ) 

P 2 r (t„ 3 + twi,*wi) + (i - 2p 2 )r (i w3 , o) + p 2 A- d ^ 2 (t wl /t w2 )r (t w3 + twl t v 



(96) 



Here To is the one obtained in the solution for standard coarsening ( p9|) with un-biased random initial condition. It 
is again useful to define the relative ratio of the contribution of the three terms in the last equation as, 

(97) 
(98) 

TTi (iw3 > t w 2 j twl ) — p A ' (£ w lAw2)ro t w 3 + "TT: 77 r,twl ) /T 'l-step(tw3 + *w2 + twl , t w 2 + twl)' (99) 

\ A(t w i/t vr 2) J 

The structure-factor of the projected field to a is obtained using (p2h as, 



''mem(tw3j t w 2, twl) — P To(tw3 + t w l i twl)/ri-step(tw3 + t w 2 + t w l, t w 2 + t w l), 
m rcj (tw3 , tw2 , t w l ) = (1 — 2p )Tq (t w 3 , 0)/ri_ st ep(t w 3 + t w 2 + t w i, t w 2 + twl), 



-2k z U 



W£{t w3 + t w2 + twl) = W^(t w2 + twl) 



ri-stcp(t w 3 + tw2 + t w l, t w 2 + t w i) 



(100) 



where W^(t W 2+t w i) is given in ( |93| ) and ri_ step ( tw3 + t W 2 +t w i , t W 2 +t w i) is given in (P6|) - Then the spatial correlation 
function of the projected field is obtained using (|100|), (p3|) and (190) in (b3) as, 



C(r, i w 3 + t w2 + t w l j t w 3 + t w 2 + t w l ) — "Jmc, (t w 3 , t w 2 1 t w l ) exp 



8(tw3 + twl) 



+ TO rej (t w 3,tw2,twl) exp - 



S/ 



w3 



+ m 2 (t w3 ,t w2 ,t w i)exp 



8(tw3 + t w l/^4(twl/t w 2)). 

In the last equation we used the parameters introduced in (971), d9q) and (99h. Note that there is a sum rule, 



2 , 2 

m mem ' TO rcj 



fa =1, 



(101) 



(102) 



by the definition of the parameters. Obviously the first term in (101) can be physically understood as the correlation 
due to the continuation of the 'ghost domains' (memory). The amplitude m mom can be regarded as the staggered 
magnetization associated with the continuation of the 'ghost domains'. Similarly the second term can be interpreted 
as the correlation du e to r e- start of coarsening within the ghost domains (rejuvenation), which we called 'inner- 
coarsening' in section IIIC . The role of the last term depends on relative ratio of the size of the domains in the first 
and second regime as we discuss later. 

Now we discuss the change of the profile of the spatial correlation function with increasing time t w3 in the third 
stage. We assume that the duration of the second regime is large enough so that the bias has become very small p <C 1. 
Then at the beginning for small t w3 , we find the parameter defined in ( |9q ) is to 2 • ~ 1 while the other two m^ 
and m 2 defined in (971) and (99) are very small. Then the second term in ( |l0l| ) which represent the inner-coarsening 
(rejuvenation) is therefore dominant, 

C(r, t w3 + t w2 + t w i, t W 3 + tw2 + t w i) — exp 



£(*w3) 



mner-coarsenmg regime 

On the other hand, in the asymptotically large time scale such that L(t w3 ) 
correlation function becomes, 



(103) 
£(t W 3+t w i), (i-e. t w3 — t w i), the spatial 



C(r, t w3 -I- t W 2 + twi, t W 3 + t W 2 + t w i) — exp 



outer-coarsening regime 



i(t W 3 + t w i) 



(104) 



IIIC 



Here we used the sum rule (102). This regime can be interpreted as the outer coarsening regime we discussed in 
section 



We have discussed in section [II C that the crossover between the inner-coarsening and outer-coarsening regime 
depends on the relative domain sizes of the first and second stages. We will indeed find below that it is the case in 
the present model. In the following we consider the two limiting cases: a) L(t w i) 3> £(t W 2) and b) L(t w i) <C L(t w2 )- 
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3. Rejuvenation and memory -.Case a) 



We consider the case a) £(i w i) 3> L(t W 2) ■ the duration of the first stage is much longer than the second. In this 
case the parameter m 2 is very small compared with m 2 : since A ^> 1 as one can see in (^J). Thus we neglect the last 
term in the spatial correlation function given in (|lOl| ) . Then the basic structure of the correlation function (|lOl| ) can 
be naturally interpreted as a sum of Gaussian packet due to the inner-coarsening (rejuvenation) whose size is L(£ w3 ) 
(second term) and that due to the cont inua tion of the 'ghost domains' (memory) of size L(£ w3 + t w i) (first ter m). In 
this case, the inner-coarsening regime (103) terminates due to the effect of the bias as we discu ssed in section IIIC. 
Furthermore there is an intermediate regime which we called 'plateau regime' in section III C so that rejuvenation 
and memory effects can be observed in a well separated manner. 

Let us consider the characteristic time scale at which the staggered magnetization of the ghost domain m mcm defined 
in (P7T) and m rc j defined in (198) become the same order. For short times such that £(i W 3) •C £(£ w i), we can assume 
To (£w3 + twi , t-wi ) ~ 1 in ( pTJ) . Then the time scale r roc (p) at which m 
using (p9|) as, 



ln ,. m and m rc j become the same order is obtained 



p~(L{ Tlcc (p)/L )-\ 

which is the same as ( JS2| ) obtained in the limit L(t w x) — > oo. Note that the assumption ro(£ w i 
satisfied because the bias is p ~ (L(t W 2)/L )~ x as given in ( |92] ) which implies 

^(Trec(p)) < L{t wl ). 



(105) 
£w3,£wi) ~ 1 is still 



(106) 



When the inner-coarsening regime ends, we are left with the the 'ghost domains' which have almost recovered their 
full staggered magnetiz ation m mcm — 1- The latter can be interpreted as the fact that the 'real domain' are recovered. 
However, the relation (106) implies that the relaxation time T rec (p) is not large enough to grow the revived domain 
further. Thus there is an intermediate regime where: 



C(r, £ w3 + t w2 + t wi , t w3 + t w2 + twi) — exp 



L(i w i), 
plateau regime £(i w i) S> L(t w3 ) > L(r rec (p)). 



(107) 



This is the plateau regime in which the revived domain appears frozen in time. Thus the memory (spatial structure 
of bias) conserved in the system is retrieved with its original full amplitude recover ed w ithin this regime. Much later 
in time, the plateau regime is followed by the asymptotic outer-coarsening regime (104). 



4- Complete rejuvenation: Case b) 



Next we discuss the case b) L(t w i) <C L(i W 2): the duration of the first stage is much shorter than that of the second 
stage. In this case we find that the two contributions defined in (|9q ) and (^9|) become essentially equ al m^ em ~ m 2 
since A ~ 1 holds as one can see in (M). Thus the basic structure of the correlation function ( J101D can be again 
naturally interpreted as a sum of Gaussian packet due to the domain of inner-coarsening (rejuvenation) whose size is 
L(£ w3 ) and that due to the continuation of the 'ghost domain' (memory) of size L(t w3 + £ w i). 

However, the amplitude of the memory terms m 2 nem (~ m 2 ) does not recover much and only saturate to a small 
value ~ (£(£ w i)/-£'(£w2)) A < 1 as L(t w3 ) ~ L(£ w i) (£w3 ~ £wi)- In the latter regime, the width of the memory and 
rejuvenation terms become of the same order, 



L(t w s) ~ L(t w i + £ w3 ); 



t 



w3 



u 



(108) 



Thus the correlation function crossovers very smoothly to the asymptotic outer-coarsening regime (104) so that the 
memory cannot be retrieved. The resultant behavior of the correlation function is not very different from the case of 
t w = 0. In this sense the relaxation is almost completely rejuvenated. 



5. U-turn in the Phase Space 

The above result implies the time evolution of system in the phase space during the third stage is such that it makes 
an U-turn to configuration before the second stage (inner-coarsening) and stay there for a while (plateau-regime) and 
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finally make further excursion (outer-coarsening). Such a feature can be elucidated by considering overlap q between 
the configuration just after the first stage and the temporal configuration in the third stage. It is readily obtained as, 

/d d k f d d l 
/ 2 w / ,„ y « 0fe(*w3 + t w2 + twl) ><j 4>l{twl) >ini 

d d k pe- k2t - 3 ^ ^ _ pri_ stcp ((iw3 + Url + twl)/2, t w2 ) 



V ri-stcp(^w3 + t w 2 + t w l, t w2 + t w l) V ri_ s top(^w3 + t w 2 + t w l, t w2 + twl) 

= Co{t W 3 +iwi,t w i)m mem (i W 3,i W 2,twi)- (109) 

In the last equation we used the ratio m mcm defined in (|97| ) and Co is the auto-correlation function of standard 
coarsening J62J). 

As we found in the previous sections the ratio m mem (i W 3, t W 2, t w i) can be physically understood as the stuggard 
magnetizati on w hich increases with t W 3 in the third stage. On the other hand, the factor Co(t W 3 + t w i,t w i) which 
appears in ( |l 09| ) describes de-correlation due to outer-coarsening. 

The competing effects of the inner-coarsening and outer-coarsening make the overlap q(t w s) non-monotonic in time 
t W 3. In the case a) £(£ w i) ^ L{t W 2) the behavior is the following. It increases during the inner-coarsening because of 
the increase of m mcm and almost saturate to 1 at time scale t W 3 at around the recovery time T iec (p). It stays close 
to 1 during plateau regime. Then in the outer-coarsening regime, it decreases with time. This picture apparently 
becomes invalid in the case of b)L(t w i) -C L(t w2 ). 

E. Three-Stage Relaxation of Auto-Correlation Function after One-Step Cycling 

We now turn to more conventional observables with which the rejuvenation and memory effects can be see easily. 
While the spatial correlation function of the projection field discussed above is convenient for theoretical discussions, 
it is obviously impractical in simulations and experiments of spin-glasses. In this section, we consider auto-correlation 
functions and linear response functions in the next section. These quantities are invariant under changes of projections 
and can be measured directly in numerical simulations and experiments. We will demonstrate that the characteristic 
three-stage relaxation after one-step cycling: inner-coarsening (rejuvenation), plateau and outer-coarsening (memory) 
regimes show up explicitly in these two-time quantities. 

The auto-correlation function between two times in the third stage is obtained using (|96| ) in (|35|) as, 

C(t + t' otal , C tal ) = ri- Btop (r/2 + 4 ot al t w2 +t wl ) 

VTi-stepCr + 4° tal , t w2 + twl) V / ri-step(4° tal , tw2 + twl) 

with 

*w a — ^w3 + t w 2 + t w l (HI) 



Here the explicit form of the T- factor is given in (|96|). As we discussed in section [HE, the auto correlation function 
can be related with the DC-magnetic susceptibilities measured in experiments. 

First, let us look at the simplest case t W 3 = : i.e. the correlation between the configuration just at the beginning 
of the third stage and the configuration a time r later. Here we only consider the case a) L(t w i) ^> L(t W 2) which 
allows clear separation between the inner- and outer-coarsening regimes. Within the inner-coarsening regime r <ti T Tec 
the amplitude of the ghost domains is small m mcm <C 1 and to 1c j ~ 1. When the inner-coarsening ends at r ~ r rcc , 
the amplitude of the ghost domains is almost recovered: m mcm ~ 1 and m rc j <C 1. Then one can see easily that the 
correlation function have the following feature, 

C(t + t w2 + i w i, t w2 + twi) = C (r, 0) L(t) < L(t icc ( p )) (112) 

P C (t + twi, twi) L{t) > L(T Iec (p)). (113) 

Here Co is the auto-correlation function in the standard coarsening given in ( |l09| ). The result confirms the scaling 



property ( J30| ) conjectured in section HIE. It visualizes clearly the cross-over from inner-coarsening, plateau regime 
and outer-coarsening. Note that in the limit L(t w i) — > oo, the last relaxation does not occur Co (r + t w i , t w i ) = 1 & n d 
we recover the result of the case in which we start from fully symmetry broken state with respect to phase a. (see 
©and©) 

We present some plots of the auto-correlation function C(r + t w2 + t w i, t w2 + t w i) in Fig. || and |7] for the case of 
d = 1. The generic feature is of course the same at any dimension but the dynamical exponent for the decay depends 
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on the dimension as A = d/2. Here the three-stage relaxation is clearly visible. Note that the plateau is visible only 
for the cases in which i w i 3> £ W 2, which is the condition to have sharp separation between the inner-coarsening and 
outer-coarsening. 
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FIG. 6. The auto-correlation function C(t + i W 2 + i w i,£w2 + iwi) in the 0(n) Mattis model (d = 1) under one-step cycling. 
The dotted lines are curves with common i w2 = 10 4 but varying t wl = 10 2 , 10 4 , 10 6 , 10 s , 10 10 , 10 12 (from left to right). The 
solid line on the top is the curve with £ W 2 = 10 4 but with t w i = oo (top). The dash-dotted line is the reference curve with zero 
waiting time of standard coarsening Co(r, 0).(left most) 
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FIG. 7. The auto-correlation function C(j + £ W 2 + £ w l,£w2 + £wl) in the 0(n) Mattis model (d = 1) under one-step cycling. 



The dotted lines are curves with common £ w i = 10 10 but varying £ W 2 = 0, 10 2 , 10 4 
lines are the reference curve of t w i = oo but varying £ W 2 = 10 2 , 10 4 , 
reference curve of zero waiting time of standard coarsening Co(r, 0) 



10", 10 s (from top to bottom). The solid 
10 6 , 10 8 (from top to bottom). The dash-dotted line is the 
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FIG. 8. The auto-correlation function C{t + 4,4) with 4' = *»3 + tw2 + twi in the 0(n) Mattis model (d = 1) 
under one-step cycling plotted against the time difference r in the third stage. In section [V|, we compare these curves with an 
experimental data of the relaxation of thermo-remanent magnetization after one-step temperature cycling. The thin solid lines 
are curves with common t w l = 990 and f W 3 = 10 but varying £ W 2 = 10 6 , 10 5 , 10 4 , 10 3 , 10 2 , 10 1 . (from left to right) The dotted 
lines are the corresponding curves with twi = oo. The top and bottom bold solid lines are the reference curves of standard 
coarsening Co(t + 1000, 1000 and Cq(t + 10, 10) respectively. 



Second, let us consider more complicated cases with non-zero t w a > 0. The reason we analyzed it is to make 
comparison with a set of conventional TRM data (?]] where such a protocol is used. |j Later in section VI , we compare 
the resul t wit h an experimental data. In Fig. H we show a plot of the auto-correlation function C(t + 4 >tal t^ )tal ) 
given in ( 110 ). We also show curves of the special case where £ w i — > oo. It can be seen that the initial decay does 
not depend on £ w i and decays as the case t w \ = oo. This is the inner-coarsening regime which then crossovers 
to the plateau regime. Finally, the departure from the plateau due to outer-coarsening becomes visible at around 

L(r) ~£(«ws + *wi). 

The plateau value is nothing but the staggered magnetization within the ghost domains at time t W 3 + t W 2 + t w i • The 
latter is naturally smaller for longer duration of the second stage £ W 2 . But note that it also depends on t W 3 because 
the staggered magnetization tends to go back to the full value 1 in the third stage, (see (|3|)) The last feature imply 
that rejuvenation is obscured in this protocol. Nonetheless, for any t W 2, the presence of rejuvenation (inner-coarsening 
regime) can be recognized by comparing with the curves with much larger i wl as demonstrated in the figure. 



F. Short time Linear Response Functions in One-Step Cycling 

Within the spherical Mattis model, it is also possible to study directly the linear response function exactly. We 
study it below for the one-step cycling protocol and focus especially on its behavior in the third stage. Here we 



Tn any case, it may be impossible to realize strictly £ W 3 = in experiments. 
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will consider response functions R(At + t, t) with fixed time separation At as a function of increasing time t. ft 
is analogous to the relaxation of AC-susceptibilities x"{u>,t) of frequency uj = 1/Ai at time t. The advantage of 
studying R(At + 1, t) is that its analytical expression is simpler than that of x"( w i *)■ Some details of the calculations 
are presented in appendix |Q . We will find the anticipated crossover from inner-coarsening to outer-coarsening in the 
response sketched in section p 1 D . 



It should be noted however that mean field theories 1 27 - 25J] suggests long time behavior of the response is likely to 



be quite different between spin-glass and usual coarsening systems as we noted in section HIE. Nonetheless, as far 
as short-time response is concerned the generic behavior of the response function may be similar. 

In the first stage the relaxation is the same as in the standard coarsening and we naturally find new relaxation also 
in the 2nd stage, 

Ri(At + t,t) = R Q (A + t,t) 
Ru(At + t,t) = R {At + (t - t w i), t - t wl ) (114) 

Here R is the response function scaled by that in equilibrium and Rq(A + 1, t) is the rescaled response function of the 
standard coarsening (see appendix |c| for the details) . 

One finds richer behavior of the short-time response in the 3rd stage i W 3 + i W 2 + £ w i > t> £ W 2 + 'wi as obtained in 



( Cll ) and ( C12 ). we find the following. At the beginning of the third stage which is the inner-coarsening regime, we 
find new relaxation. On the other hand, in larger time scale which we called as plateau and outer-coarsening regime, 
we find continuation of the 1st stage. 

i?m(Ai + i, i) — Ro(At +t— t w2 — t w \,t — t w2 — £ w i) inner-coarsening regime (H5) 

_Riii(A£ + t, t) ~ Ro(At + t — t w i, i — ^wi) plateau/outer-coarsening regime (H6) 

In the case a) L(t w i) 3> L(t W 2) which allows the plateau regime, the inner-coarsening regime finishes before the 
significant relax ation due to the outer-coarsening starts. The generic feature is consistent with the picture presented 
in section 1IID| . (see Fig.||) 



G. Multiplicative Noise Effect and 2-Step U-turns in a 2-Step Cycling 

One can extend the abov e calc ulations to two-step cycling a— >/3— +7— >/3— +a, trying to mimic the multi-step 



cycling discussed in section |HIF . Although the full calculation will be become too lengthy, we can readily have a 
glimpse of what happens in the spherical model. 

Let us suppose that we are given a spin-configuration whose projection to a certain equilibrium state a is <^?(0). 
We consider to give this as initial condition for a one-step cycling /3(i w i) — > 7(^2) - ► /?(iw3) and monitor the time 
evolution of the projection to a. One finds that the expectation value of the projection </>^(£ W 3 + t W 2 + ^wi) at time 
t-w3 + ^w2 + t-wi as, 
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In the derivation of the last equation, we used (A8), ( p9| ) (|62j) and (|97|). Thus we find that the expectation value of 
the projection field is proportional to the initial one 0^(0) with time-dependent prefactor. 

A remarkable point is that the prefactor is product of m mem (£w3, ^w2, *wi) and the auto-correlation function Co(i W 3 + 
t w i, 0). At the beginning of the last stage (2nd /3-coarsening) , we readily find that the prefactor is C(£ w i, 0)p where p 
is the reduction of the amplitude due to 7 coarsening. The latter means multiplicative reduction of the amplitude of 
the p rojection onto a due to the successive coarsening of two different phases (/? and 7) as we conjectured in section 
III F|. The fact that noise effect is multiplicative, can be check explicitly in more general multi-step coarsening as 



presented in appendix |B] (sec (B9)). 

In the inner-coarsening regime of the last stage (2nd /3-coarsening), we readily find that ra me m(tw3, £w2, twi) almost 
returns back to 1 within the recovery time r rcc so that the noise due to 7-coarsening onto (3 is now removed. As far as 
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time separation is wide enough so that the plateau regime is allowed, the recovery time r rec is much shorter than t w \ . 
Within the plateau regime Co(i W 3 + t w i,0) ~ Co(t w i,0). Remarkably, then the above formula flll7|) implies that the 
noise onto a due to 7 coarsening is also cured thanks to the 2nd /3-coarsening and the remnant noise is now only that 
due to j3 phase. But if one perform the 2nd /3-coarsening too long, the factor Co(t W 3 + £wi>0) will begin to decrease 
further meaning that the noise due to f3 coarsening will now begin to affect the projection to a. 

If one stops the 2nd /3-coarsening at around r rcc and then switch to coarsening of a, the remnant noise due to /? 
phase will be removed. The above result demonstrates that the system can be returned back t o the starting point in 
the phaser space by two-step U-turns. This is consistent with our picture presented in section III F for the recovery 
of memory in multi-step cycling. 



V. TWO-DIMENSIONAL ISING MATTIS MODEL 



While the 0(n) model in the spherical limit is analytically tractable and contains the essential phenomenology of 
coarsening systems, its drawback is that it does not contain topological defects like domain walls |p2|] . Thus it is 
desirable to study models which have clearly defined domain walls. In the present paper, we do not pursue more elab- 
orate analytical calculations to take into account topological defe cts lik e the Ohta-Jasnow-Kawasaki approximation. 
Instead, we directly study the Mattis model introduced in section III A with Ising spins on a two-dimensional square 
lattice by Monte Carlo simulations. 

The algorithm is zero temperature Monte Carlo dynamics with multi-spin coding. The spin configurations {cf } 
in the ground states are chosen to take ±1 randomly. 



A. Auto-Correlation Function after One-Step Cycling 



We simulated the o ne step cycling process A — ► B — > A described in section III C , which was studied in the 0{n) 
model in section 1VD. We examined the auto-correlation function between the configuration just at the beginning of 
the thir d sta ge and the temporal configuration after time r in the third stage, which was studied in the 0(n) model in 
section EVE. The system size is 8192 x 8192 which is large enough to avoid finite size effects within the time window 
we have explored ~ 10 4 (MCS). 

In Fig. pi and Fig. W(] we present the result of the auto-correlation function. We included the results of simulations 
in which the ground state of phase a is given to the second stage as the input, i. e. the t w \ = 00 limit. By comparing 
with the corresponding results within the spherical model shown in Fig. || and Fig. M, o ne can see a very similar 



structure of the relaxation curves in agreement with the conjecture presented in section EIIE. The initial decay implies 
inner-coarsening regime where the correlation decays as if the memory of the first stage was completely lost. The 
subsequent behavior implies however that the memory of the first stage is not lost but its amplitude is reduced from 
1 to p < 1 at the beginning of the third stage. 



B. An Example of Multiple-Memory 



In section III F we discussed coarsening under cycling of multiple phases. Especially we argued that i) the noise effect 
of multiple phases are multiplicative and that ii) the multiplicative noise can be removed one by one by additional 
series of c oarsen ing in the reversed order. We have verified the picture within the spherical model to a certain extent 
in section IV G . Here we present a demonstration of the coarsening under cycling of three independent target states 



in the 2-dimcnsional Ising Mattis model where the two features i) and ii) appear explicitly. 

In Fig O we show the time evolution of the projection to three completely different ground states A, B and C 
during two-step coarsening A(t w i) — + B(t w2 ) ^> C(t w3 ) — > B(t' w2 ) — » C(t' wl ). We chose i w i = 10000, t w2 = 100, 
t W 3 = 2, t' w2 = 4 and t' wl — 200 (MCS). The time schedule is decided according to the principle explained in section 
IIIF. First, the first series A — > B — » C is designed such that the length scales of the three-phases are well-separated 
£ w i ^> t w2 3> tw3. Second, the reversed series B — * A is designed such that multiplicative noise is removed one by one 



without accumulating additional noise: t w2 > t' w2 > ^w3 and t 



&wl 



> t w i > iw3- 



One can find that noise on A in the end of 3rd stage is very large. The latter is due to the multiplicative effect of 
noise. It will take enormous time to remove the noise by a single stroke which well exceeds i w i so that recovery of 
memory is hopeless. However, one can find that memory the spin-configuration at the end of 2nd and 1st stages are 
recovered by the 4th and 5th stages respectively (as shown by arrows in the schematic picture.) Thus th is exa mple 
demonstrates that multiple memories can be indeed stored and retrieved successively as argued in section III C . 
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FIG. 9. The auto-correlation function C(t + i W 2 + £ w i,tw2 + iwi) in the d = 2 Ising Mattis model under one-step cycling 
plotted versus r (MCS). The dotted lines are t w2 = 20 MCS and t wl = 100, 300, 1000, 3000 (MCS) from left to right. The solid 
line on the top is the case t w i = oo. The dash-dotted line is the reference curve with zero-waiting time. 
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FIG. 10. The auto-correlation function C(t + £ W 2 + twi, iw2 + twi) in the d — 2 Ising Mattis model under one-step cycling 
plotted versus r (MCS). The dotted lines are t w i = 1000 MCS i W 2 = 0, 2, 4, 8, 16, 30, 50 from the top to below. The solid lines 
are with t w i = oo. The dash-dotted line is the reference curve with zero-waiting time. 
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FIG. 11. The projection of the spin configuration onto the ground state A, B and C (from top to bottom) at the end of 
each stage in the in a 2-step cycling. The columns are in the chronological order. Here i w i = 10000 ,t W 2 = 100, £ W 3 = 2, 
42 = 4,Ci = 200 (MCS). The system size is 1024 x 1024. 

VI. COMPARISON WITH TEMPERATURE-CYCLING EXPERIMENTS IN SPIN-GLASSES 



We now discuss on the temperature-cycling experiments in spin-glass from the present point of view. For reference, 
we consider the data of experiments on the CdCr1.7Ino.3S4 (T c = 16.7K) insulating spin glasses. Because of the 
limitation of pages we cannot discuss another rich set of experimental results obtained in Cu:Mn metallic spin-glass 
|12| H w hich show essentially same features. For AC-susceptibility in one-step temperature cycling we refer to mO 11 
and |15| for multi-step (continuous) temperature cycling. For DC-susceptibilities we refer to the measurements of 
thermo-remanent magnetization (TRM) on the same CdCr\ jIuq 3S4 system reported in M which can also be found 
in §1. 



A. AC-susceptibility in One Step Temperature-Cycling Experiments 



We consider first the measurements of the out-of-phase AC susceptibility x "(cj, t) in a one-ste p tem perature cycling 
procedure, and interpret them according to the picture presented in section IIIC| and section HID. In Fig. 12 the 
data [|10| of the relaxation of x"(oj,i) at uj/2-n: = 0.1Hz is shown. Note that the schematic picture presented in Fig. 
H agrees well with the general feature of the data. The third regime can be naturally understood as containing both 
the inner-coarsening regime and outer-coarsening regime in a well separated manner. We expect that the duration 
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of the inner-coarsening regime is given by (|2lJ). This yields r rcc ~ 700 (sec) at Y1K using the microscopic time scale 
T = 10~ 13 (sec) and the duration of the second stage £ w2 ~2x 10 4 (sec) at UK. The order of magnitude of the 
latter is compatible with the duration of the transient relaxation ~ 2500 (sec) seen at the beginning of the third stage. 
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FIG. 12. Relaxation of \" during an one-step negative temperature-cycling experiment V2K — * UK — > 12K as a function 
of time. The inset shows points taken during the first and third stage at T — Y2K plotted against the total time spend at 
T = 12K. The solid line is a reference relaxation curve of isothermal aging at T — Y2K. 

In Fig. [TJ the data [jll|] of a similar experiment but with a larger AT is shown. In this case the relaxation of 
the inner-coarsening regime is expected to be, from (|2|), r rcc — 27 (sec) using to = 10~ 13 (sec) and the duration 
of the second stage £ W 2 ~ 350 (min). Note that this is of the same order of the period of the AC measurement 
2tt/uj ~ 10 (sec) so that condition (24) needed to observe the inner-coarsening regime is barely satisfied. Because 
of the temperature dependence of the stiffness of the barrier (g) , r roc would be even shorter and the condition ( |24| ) 
would be strongly violated. This could explain why the transient relaxation seen in Fig.O is absent from the data, 
and that full memory can be expected. 
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FIG. 13. x" relaxation during an one-step negative temperature-cycling experiment 12K — > 10K — ► 12K as a function 
of time. The inset shows points taken during the first and third stage at T — 12K plotted against the total time spend at 
T = 12K. The solid line is a reference relaxation curve of isothermal aging at T — 12K. 

Now let us consider the data pi corresponding to a positive cycling in the same system, which is shown in Fig. IT3. 
In this case the duration of the second stage i W 2 ~ 6000 (sec) at 13K amounts to effective time (^) of 10 5 sec at 12K, 
which is much larger than the duration of the first stage (£ wl ~ 4000 (sec)). Thus in the third regime we expect that 
the inner-coarsening regime and outer-coarsening are not separated, and that the obtained relaxation is very close to 
the one obtained in the first regime (no memory). 
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FIG. 14. x" relaxation during an one-step positive temperature-cycling experiment 12K —> 13K —* 12K as a function 
of time. The inset shows points taken during the first and third stage at T — 12K plotted against the total time spend at 
T = 12K. Note that the second curve can nearly be superimposed onto the first one by an horizontal shift of 4000 seconds. 

To summarize we found that the present picture is compatible with the experimental data of the out-of-phase AC 
susceptibility during one-step temperature cycling. In particular, the memory effect for negative cycling is explained 
by the fact that the inner-coarsening regime ends after a time so short that it cannot be observed. 

In the cases discussed above, we did not need to take into account the fact that the overlap length {at become 
very large when AT — ► 0. However it should be noted that the overlap length associated with any fluctuations of 
temperatures in experiments should be large enough compared with the dynamical length scales explored. Otherwise 
experimental temperature becomes meaningless. Indeed, there are some data which suggest that {at depends on AT 
[Of. For example the data of negative cycling between very close temperatures 12 — > 11. 7 K — * 12K of the insulating 
spin-glass shown in |ll| reveals that the relaxation during the second stage at 11.7 K 'helps' relaxation at 12K to a 
certain extent. 



B. DC-susceptibility in One Step Temperature-Cycling Experiments 



Let us now consider the relaxation of the thermo-remanent magnetization (TRM), which is a DC susceptibility, 
after similar one-step cycling. A representative data set is shown in Fig. |l^ which is taken from g|. Here a positive 
temperature cycling 12K — ► 12K + AT — ► 12K is done under small magnetic field which is then cut-off. Then the 
subsequent relaxation of the magnetization is measured. Here the duration of the second stage is fixed to 5 minutes 
but the amplitude of the shift AT is varied. 

Now let us compare the experimen tal da ta with the correlation function after a one-step cycling in the 0(n) Mattis 
model, which we analyzed in section IV E . Here we suppose that the generic features of the correlation function and 
TRM decay are similar. It should however be noted that this is not obvious since the violation of the fluctuation 
dissipation theorem (FDT) in such non-stationary situations |pT|j29| , |3Cf| does not allow an exact identification of the 
two quantities. Second, we again disregard the possible finite value of {at between the different equilibrium states at 
different temperatures and consider that they are completely uncorrelated. 

The activated dynamics (0) implies that for larger AT, the coarsening in the second stage reaches larger length 
scales Li2K+AT{t W 2), so that more 'noise' is added to the 12K domain structure. Thus we suppose that larger AT 
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in the experiment corresponds to larger t W 2 in our model. Indeed the experimental curves shown in Fig FTq appear to 
be very simi lar to the result in the Oin) Mattis model shown in Fig. || 

In section [VE| . we found that the generic features of the auto-correlation function can be understood as crossover 
from rejuvenation (inner coarsening) to memory (outer-coarsening). This crossover is sharp only in the case a) where 
the second stage is effectively much shorter than the first stage (t W 2 <C t w i). On the other hand, in the case b) where 
the second stage is effectively much longer than the first stage, rejuvenation is nearly complete. 

Let us note that the curve in FigJ8] with AT = 2.5K belongs to the case b) because the effective time (g) of 5 
minutes at 14.5K amounts to 8400 min at 12K (with tq ~ 10~ 13 (sec)), which is very large compared with t w i = 970 
min. On the other hand, AT = 1.5K and IK can be considered as cases of a) since their effective time 430 min and 
97 min at 12K are smaller than t w i. It would be very interesting to look experimentally for the plateau regime as 
seen in FigJ|, |, § and Fig. g, [l0| 
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FIG. 15. Relaxation of the thermo-remanent magnetization (TRM) at Y2K after a one-step positive temperature-cycling. 
The procedure is shown in the inset. The reference curves of t w = 30 (min) and i w = 1000 (min) of standard (isothermal) 
aging are also shown. 



C. Multiple Step Temperature-Cycling 



Finally let us consider the multiple-step (continuous) version of the temperature cycling which has been studied in 
recent experiments p^ , pT|-^6 using the out-of-phase AC susceptibility x"(w, t). Here we discuss based on the scenario 
we developed in section [II F . In Fig. W(l an example of the data taken from fl5l] is shown. 

The basic schedule is a negative-cycling which consist of cooling and heating procedure. In the cooling, the 
temperature is reduced successively by 'micro-quenches' of small temperature step AT, T = T s t a rt — iAT with 
(i = 1,2, ... ,n) where T sta rt is the starting temperature and n is the number of steps. At every temperature T$ a 
short period of time ti = At is spent. In this experiment, AT = 0.5K and At = 5min J34J. In the heating, the 
temperature is raised back successively by the same AT with a the same period t[ — At at each temperature. 

Within the present scenario, coarsening of new phases are expected at every temperature in the cooling and the 
heating is the revered order series of coarsening. Note that the above basic schedule satisfies the condition (B3h to 
retrieve the memory at each temperature in the heating. For instance ( |2l| ) implies the noise due to AT = 5 min 
at 10 K on the phase at 10 + AT = 10.5 K can be erased quickly within r roc ~ 1 (min). Indeed, it is found in the 
experiment that the reference curve of cooling and heating lie close to each other [[l5[ . Concerning the frequency of 
AC cu/2n ~ 0.04 (Hz), we need to suppose that it is low enough so that the signal of the cleaning (inner-coasting) 
does not blur the observation of the memory. 

In the experiment, an interesting modification is made for the cooling procedure: now two special temperatures 
(9 and 12 K) are chosen to make relatively long stops t s t op ~ 40, 7 hours in stead of the short period At = 5 min. 
But all the rest of the basic schedule is unchanged. The dips in cooling curve mean relaxation due to the long aging. 
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Then the fact that the cooling curve tend to return to the reference curve (without stops) after the long stops implies 
coarsening of the new phase within the present scenario. 

Let us the consider the heating curve. As the temperature comes up to the stop temperature 9 K, the curve goes 
downward tracing the cooling curve. The latter is expected within the present scenario since as soon as the noise due 
to coarsening at lower temperatures are erased, we are left with the large ghost domain at 9 K with its full amplitude 
recovered. The same phenomena happens also for 12K. 

The phases at the temperatures just above 9 K an d 12 K are expected to be very noisy due to the long stops. 
The latter belongs to the case b) discussed in section III C 2 and their memory may be hardly retrieved. Then the 
increase of the heating curve after passing the stop temperatures may be interpreted as the signal of inner-coarsening 
(rejuvenation). Furthermore, the long stop at 9 K of 40 hours could have affected the memory at 12K. However, its 
effective time turns out to be only 4 sec at 12 K. If the stop temperatures are closer, the recovery of memory could 
have been affected more. Such a phenomena is indeed observed in some experiments JL6| | . 

Finally let us also note that the 'dips' are rounded in the experimental data, while we would have expected sharper 
dips. In the present scenario, the rounding of the dips may be attributed to fmitcness of the overlap length. 
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FIG. 16. Out-of-phase susceptibility x" °f the CdCr1.7Ino.3S4 spin glass. The solid line is measured upon heating the 
sample at a constant rate of O.lK/min (reference curve). The data during cooling (not shown) lies close to but slightly above 
the solid line. Open diamonds: the measurement is done during cooling at this same rate, except that the cooling procedure has 
been stopped at Y2K during 7h and then 40/i at 9K to allow for aging. Cooling then resumes down to 5K: \" is not influenced 
and goes back to the reference curve (chaos). Full circles: after this cooling procedure, the data is taken while re-heating at 
the previous constant rate, exhibiting memory of the aging stage both at 9K and 12K. The inset shows a similar "double 
memory" experiment performed on the Cu:Mn metallic spin glass. 

VII. SUMMARY AND OPEN PROBLEMS 

A. What we have done in this paper 

The basis of our approach in the present study is the droplet picture. The fundamental ingredients of the present 
paper are the tenets of the droplet theory, namely: i) for a given temperature below the critical temperature, there 
are only two equilibrium states related by a global flip; ii) the relaxational dynamics is the coarsening of the domains 
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of these equilibrium states. The growth of the domains is due to the thermal activation of droplets; iii) the underlying 
equilibrium states change chaotically with weak external perturbations, such as a change of temperature. 

By a combination of scaling arguments, analytical calculations and numerical simulations, we have demonstrated 
preservation and retrieval of memory is possible in a very dynamical way in the absence of any underlying static 
backbone structure. First, we showed that preservation of memory is possible by 'ghost domains' (domain wall 
structure plus noise) of all the phases the system goes through in the temporal spin-configuration. Here coexistence 
of statistically independent domains only amount to mutual injection of uncorrelated short-range noise which do not 
destroy large scale spatial structures of each other. Thus in order to describe the spin-configuration, one needs to keep 
track of the projections to all phases. In this sense, there are indeed many 'phases ' in the temporal spin-configuration, 
as already anticipated in the experimental studies |7|,|8|] . Then we studied in detail retrieval of memory: how the noise 
on a phase due to coexistence of the domain structures of other phases can be removed by additional conjugate 
coarsening. The analysis has been carried out explicitly in term of various spatial/temporal correlation functions 
and linear response functions. In particular, we have shown that when the time spent in the intermediate state is 
sufficiently small, rejuvenation effects and memory effects can be observed in a well separated manner. There the 
difficulty of the previous works [p|Jq,|l3|l to explain the 'memory effect', is resolved. It is rather surprising to find that 
the simplest version of the droplet picture already allows coherent and rather rich phenomenology which can account 
for experiments at least qualitatively. 

B. Is the picture totally satisfactory ? 

The droplet picture itself is based on phenomenological scaling arguments and Migdal-Kadanoff type real-space 
renormalization-group calculations [Jljg]. It is by no means obvious that real spin-glasses can be described within 
this simple scenario. Many papers have appeared recently, presenting relatively strong evidence against the simplest 
version of the droplet theory J39,|4l],[42| . On the other hand evidence for the validity of the basic droplet picture has 



also been provided []43| |45||80| 82] . In the present paper we have focused on the simplest version of the droplet theory. 
Any modifications due to possible corrections to the simplest version go beyond the scope of the present paper and 
we leave this issue for future studies. 

The theoretical situation of temperature chaos is also far from being settle neither in low dimensional systems nor in 
mean-field models. Early numerical investigations at finite temperatures [|70| , [7l| suggest chaos with magnetic field and 
with the change of couplings. Temperature chaos has been found in 2-d Edwards- Anderson model [|73| for ver y larg e 
length scales. Temperature chaos has also been suggested by some analytical studies of mean-field models f3q , pq , P8| . 
However recent simulations of both the SK and the 3-d Edwards- Anderson models have concluded on the absence of 
chaos with temperature |[72| (as also suggested by another analytical calculation for the SK model J37J). But there is 
still a possibility that temperature-chaos was not observed in the latter because the overlap length is larger than the 
system sizes studied. Chaotic changes of equilibrium states have also been looked for other related glassy systems. 
For instance, a large scale transfer-matrix study of an elastic string pinned in random media 0], which describes 
for instance pinned domain walls, has found some evidence for the chaotic change of the free-energy landscape with 
temperature again for very large length scales. All studies therefore suggest that 'chaos', if it exists, only occurs on 
large length scales, whereas the dynamical length is expected to be modest, even in experimental studies ]77| , |78| , due 
to its very slow growth with time. 

C. An alternative picture 

Let us now briefly compare the present scenario based on the droplet picture with another phenomenology [pip), 
based on a dynamical interpretation of the Parisi solution of the SK (mean-field) model, which suggests that the 
energy landscape is hierarchical. A concrete implementation of this picture was proposed in P4| , in terms of a 
thermally activated generalized random-energy model (GREM). To each level of the hierarchical tree is associated 
a transition temperature, such that the dynamics at this level is stationary for higher temperatures, and aging for 
smaller temperatures. A small decrease of temperature induces some rejuvenation by driving out of equilibrium a new 
level of the tree, while freezing out the dynamics at the upper levels, thereby allowing the memory to be conserved. 
This model was recently studied further in |2q], where it is shown numerically that the rejuvenation/memory effect 
is indeed already reproduced with two levels. 

A real space interpretation of this hierarchical tree proposed in p3,pfj, and further developed in p3j, in terms 
of a multi-scale dynamics. Low levels of the tree corresponds to short wavelength modes, which are only frozen at 
low temperature, while large wavelengths modes are frozen at a higher temperature and constitute the 'backbone' 
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where the memory is imprinted. The picture is particularly clear in the context of pinned domains walls J23), and 
should apply to disordered ferromagnets where the slow dynamics comes from the motion of these pinned domain 
walls HlQ. 



A closer look at the two different scenarios shows that they actually share several important points. The fact that 
the dynamics is thermally activated is crucial in both pictures, as it provides a natural separation of time scales 
for different length scales and/or temperatures. As was pointed out in fl23| , for a given experimental time window, 
temperature acts as a microscope by selecting the relevant dynamical length scales. The way memory is conserved 
is therefore common in both approaches: it is stored in large length scales which are to a large extent unaffected by 
the small length scale dynamics taking place at lower temperatures. However it should be noted that in the droplet 
picture, there is no static backbone structure in the phase space and the memory is entirely a dynamical effect. The 
mechanism leading to rejuvenation is therefore different in the two pictures: in the droplet picture, it is due to a 
complete modification of the free energy landscape with temperature, whereas in the hierarchical picture it is due to 
the progressive freezing of smaller and smaller wavelengths pa]. This picture is consistent with the simulations of 
J72| | : a broad peak in the overlap probability at high temperature is resolved into sharper and sharper sub-peaks as 
the temperature is lowered, with no overall shift. 

One should finally note that comparable rejuvenation/memory effects have now been seen in very different materials, 
such as PMMA fl7|| , where the droplet model is probably not the appropriate picture. In this respect, the idea of 
progressive freezing of smaller and smaller length scales is perhaps more generic. 

D. Further developments 

In the present paper, we discussed experimental data only qualitatively. More detailed and critical examinations 
of the scenario developed in the present paper should be done. It would be very interesting to look for the plateau 
regime which separates the rejuvenation and memory both in experiments and numerical simulations. 

A crucial difference between the two pictures is therefore the existence of an overlap length £at in the droplet 
picture. The role of this length (that we have neglected in the present paper to focus on the phenomena on larger 
time scales) should show up when the temperature change is very small (or equivalently shorter time scales are 
considered), and therefore be important to account for the possible cooling rate effects P,[L5[ in spin-glasses. We hope 
to come back to this important point in the future. We have furthermore neglected the fact that the energy barriers 
are expected to be temperature dependent in the droplet picture through the temperature dependence of the stiffness 
(||). This leads to a super-activated behavior of the time scales, as was seen in [pOf , that needs to be quantitatively 
accounted for J5l| , p2[ . 

If chaotic change of equilibrium states can be made by non-thermal perturbations like change of magnetic field |7Cf l 
or pressure, they will also provide useful means to examine the present scenario. Temperature changes may be used 
simultaneously to enhance the time separations. If the present picture is correct, such a non-thermal perturbation at 
T—AT should induce the growth of domains on very short length scales, an effect that can be erased quickly by heating 
up the system. Therefore, complete memory should also be observed in a protocol where: T — > T — AT — > T and the 
strength of the strength of non-thermal perturbation P is changed as P = —* P = AP — > P = simultaneously. 

Another good testing ground for the two approaches may be systems wi th p inned-domain walls which is inti- 
mately related with the problem of elastic manifolds in random media f57|-|6l|,|3|,|62f whose dynamics show aging effects 
33|,p8| 29 64-pT]] ■ As we noted above a very natural scenario can be obtained by a GREM based approach 123] . On the 



other hand, it is also straightforward to construct a scenario based on a droplet picture |3| for this problem in a way 
similar to our present work. A suitable toy model corresponding to the spherical Mattis model we studied here is the 
elastic manifold pinned by quenched random force field (Larkin model) subjected to cycling of the realization of the 
random force field. Concerning this issue, it is interesting to note that recent experiments on disordered ferromagnets 
and ferro-electrics have revealed several similarities with spin-glasses J19,ElJ . 

E. Some remarks on numerical simulations 

A discouraging point of the numerical approach is that the separation of time scales cannot be made so dramatic 
like in experiments of spin-glasses. However, possible differences between experiments and simulations due to such a 
difference of time scales should be amenable to a quantitative analysis. One of the great advantages of the numerical 
approach is that one can directly obtain the size of the domains Lx(t) at each time step using a spatial correlation 
functions between two real replicas. |79[ Then the scaling ansatz presented in the present paper can be tested very 
precisely since everything can be expressed in terms of the size of the domains Lt(£). Indeed this approach has been 
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very useful to test some scaling ansatz by the droplet picture || for isothermal aging. [ B0| , |32[ Furthermore, combined 
with an analysis on equilibrium properties around and below the critical temperature |8j]7this kind of approach allows 
one to quantitatively analyze possible crossovers between critical and low-temperature behaviors in the dynamical 
observables and in the domain growth law itself. |8^] 

It is important to note that due thermally activated processes which presumably dominate relaxational dynamics 
in spin-glass like systems, the length scales explored in simulations are actually very small. This might be the reason 



why rejuvenation/memory effects are hard to observe numerically [J46-48|, because both the above scenarios rely on 
the existence of non overlapping (in length scales) dynamical processes. 

The fact that the growth law is so slow also implies that both experiments and simulations will never be in the ideal 
regime of asymptotically large length scales to test the scaling predictions of droplet picture. Whether one can observe 
some clear signatures of the droplet picture within a realistic time scale may then depend very much on details of the 
systems studied in experiments and simulations. Whether the usual Edwards- Anderson model is the best model to 
describe real spin-glass systems is now hotly discussed. ]49| , ^8[ | 

We want to thank E. Vincent for the permission to use the curves of the series of experiments in Saclay, useful 
discussions and encouragement. We want to thank S. Miyashita, M. Hammann, H. Chate, S. Franz, F. Ricci, P. 
Nordblad, P. Jonoson and R. Matthieu for useful discussions. H. Y. want to thank H. Takayama, K. Hukushima, 
T. Komori and L. Bernardi for useful discussions in the collaborations with them which have motivated the present 
work. 
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APPENDIX A: PROPERTIES OF THE TRANSFORMATION FIELD 

Here we summarize some useful statistical properties of the transformation field introduced in (|42|). Due to (|4l|), 
the Fourier components of projection to different equilibrium states, say a and /3, are related as, 

'%(^h4l k „ (Al) 



(2tt 
where we defined 

{a aP ) k = f d d xa a0 {x)e lkx . (A2) 

The average becomes zero due to ([43|) , 

{{a a0 )u)„ = 0. (A3) 

and the 2-body correlation function is obtained using ( ff4[ ) as, 

((* a/, )fc(* a/J )j>, = / d d xd d x'(afa^) a e lkx e lkx ' = A(2Tr) d 6 d (k + /). (A4) 



The 4-body correlation function in the real space is, 

(^(n)^(*a)<^(i8)<^W). 
= A 2 {<5 d (xi - x 2 )5 d (x 3 - Xi ) + 6 d (x 1 - x 3 )S d {x 2 - a*) + S d { Xl - x±)5 d (x 2 - x 3 )} 
- 2A 3 S d { Xl - x 2 )5 d {x 2 - x 3 )S d {x 3 - Xi ), (A5) 

which becomes in the Fourier space, 

= A 2 {(2iT) d S d (k 1 + k 2 ) x {2n) d 5 d {k 3 + fc 4 ) + {2n) d 5 d {k 1 + k 3 ) x (2ir) d 5 d (k 2 + k A ) + {2n) d S d {k 1 + fc 4 ) X (2ir) d 5 d (k 2 + k 3 )} 
-2A 3 (2ir) d 5 d (k 1 +k 2 + k 3 + k 4 ). (A6) 

We will also need to consider projections to three different states say a, (3 and 7. A useful correlation function is, 

{a a0 {x x )a^{x 2 )c7^{x 3 )(j 0a {x i )) CT = A 2 5 d ( Xl - x 4 )S d (x 2 - x 3 ), (A7) 

which becomes in the Forier space, 

((a^) kl (a^) k2 (a^) k3 (a 0a ) ki ) a = A 2 (2n) d d d (k 1 + k 2 ) x (2w) d 8 d (k 3 + fc 4 ) (A8) 

Finally, correlation of the generalized type ( Eq ) becomes in the Fourier space, 

(a% a *a% a * . . . K:T n ° a k : ai )° = (A(2n) d rS d (k 1 + k 2 + . . . + k n ). (A9) 
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APPENDIX B: PROPERTIES OF NOISE INDUCED BY COARSENING OF UNRELATED PHASE 

Here we consider a projection field <j> a (x) associated with a ground state a a (x) and study the effect of coarsening 
with respect to an unrelated ground state a l3 (x). 

We assume that the initial projection field cf> a (x,t') satisfies the normalization condition (4> a (x, t')) 2 — f at any x 
which implies, 



m')m') = {^r d nk+im{t') 



(Bl) 



where 



Jd d kW?(t>) = l. 



(B2) 



due to (J49|) and ( |50[) . Given a spin configuration whose projection to a ground state a a (x) is (j> a (x, t') at time £', we 
project it to the ground state a^{x) to prepare the initial configuration. Using (Al), the initial condition can be read 
as, 



d d k' 



(27T) 



{^)k'4>l-At')- 



(B3) 



$(0 = 

Because of the random mapping through the transformation field (<x"^)fc, the resultant 4>^(t') should also be a random 



field. Using (A3), we find that the mean is zero, 



d d k' 



(%V))° = J j^yi^vUfa-k'V) = o 



Using (A4), the correlation function becomes, 

W(,i\W(,iy f a k f d I 



W)tf(H)) a = J j^J ™<(0*K*°*>U*-*^?-p =A(27r)^(fc + 



(B4) 



(B5) 



In the last equation, we used (Bl) and (B2). To summarize, the initial condition for the coarsening is a random initial 



condition which has only short-range correlation. The solution of the equation of motion with such random initial 
condition is known and shown in (|59|). 

By transforming the solution of <f> k (t) at time t(> t') back to the ground state a a through (Al), we obtain the 
projection field as, 



d d k' 



* m = J J^r {& ^vK-w® 



?l?*)w - m 4'(t" 






d d k' ,_„, e -( fc - fe ') 2 (t-t') f d d k" 



wr {a )ki vmm J^~ d{ )k "^- k '- k " {t) 



In the fol low ing we examine the statistical property of the resultant projection field. 

Using ( A4 ) , (|59|) and (p^ ) we obtain the expectation value of the resultant projection field as, 



(B6) 



m))a = 



d d k' 



(2ir) d J (27r) d 



{{(J M )fe'(CT M )fc") CT 



A 



(27r) d 



d d k' 



= -(fc-fc') 2 t 



VToMO 
= c„(t-f,o)&(f). 



4>Ut' 



v/ToIP 7 



-.k-k>-u»{t') 



(B7) 



By taking inverse Fourier transform we obtain, 
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b a (x,t)) a = C (t-t',0)(t> a (x,t'). 



(B8) 



We find that profile of the field is maintained on average with a reduced amplitude even after coarsening with respect 
to completely unrelated phase. The amplitude decreases as the system de-correlates from the initial configuration by 
coarsening. In section. We have discussed a special case with an initial condition in which symmetry fully-broken and 
found that the symmetry remains broken at any time. The above result is the solution with general initial conditions. 
One can consider more generalized case where coarsening of multiple different equilibrium states are performed 
successively. Suppose that coarsening of n different equilibrium states, which are unrelated with a and with each 
other, are performed in s uccession between (i n _i,t'), (i n _2, t n —i),. . . , (ti,tz) and (t,ti). Then following similar 
calculation and using ( A.9) the projection field of a is obtained as, 



(<P a (x,t)) a = C (t - ti,0)C (ii - t 2 ,0) . . . C (i„-i - t',0)</> a (x,t'). 



(B9) 



We find that profile of the field is maintained with the amplitude reduced multiplicatively every time when a new 
unrelated phase is coarsened on top of it. 



Next we consider the spatial correlation function of the resultant projection field. Using ( A6), (p9|), (|62j), (Bl) and 
(B2) we obtain, 



<*(«>#(«».- / |£/^/|f/|f«^m^<^<^>. 



,-(k-k') 2 (t-t') e -(i-i') 2 (t-t') 



i-k>-k»V)fc-i>-i»(f) 



= C$(t - t', 0)^(t')4>f(t') + A(2ir) d 6 d (k + I) [1 - 2C 2 (t - t', 0) 



1 



T (t-t>,0)(2ir) d 
The structure- factor (|49|) is obtained as, 



d d k' I d a l 



,d ] /-(k-k') 2 (t-t r )-(k+l l ) 2 (t-t') w a 



w£_ k , +l (t') 



(BIO) 



A 



W£(t) = C 2 (t - t', 0)W fc a (f) + j^- d [1 - 2C 2 (t - t> 



0) 



T (t~t>,0)(2ir) d 
By taking inverse Fourier transform we obtain, 

(0 tt (x,i)<^V,£)) ff - (^ a (a: > t)) cr ^ a (!C / > t)) ff 
= Ad d (x - x')[l - 2Cl(t - t',0)] 
1 / A ' 



d d k' / d d l'e^ k - k ^ ( - t - t '^- ( - k +^ 2 ^^W^_ kl+l (t r ) 



(Bll) 



+ 



d d k / d d 'k / d d l'e^ k - k '^^-^e-^ +l '^^-^W^_ kl+l ,(t') 



(B12) 



r o (t-t',0) \(27r) d J j" -j" ■"j""" -*-*'+!' 

The above result implies that coarsening with respect an unrelated phase induce noise with certain spatial correlation. 



APPENDIX C: RESPONSE TO UNIFORM PROBING FIELD 



Here we study the linear response of the 0(n) Mattis model to an uniform external field. After describing the 
form al solutions, we obtained the response function in the one-step cycling of equilibrium states discussed in section 
IVF. 



1. Formal Solution 



In the 0(n) model in the spherical limit, response of the field at wavelength k is only due to perturbation at the 
same wavelength. A pulse staggered field hk(t') at time t' induces a displacement of the projection field at time t as, 



8Mt)=Rk{t,t')8h k {t'). 



(CI) 
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The response function |55| associated with wave- vector k reads as, 



e -k 2 (t-t') 

W^-p^p (C2) 

where T(t, t') is defined as @. 

Now let us consider induced response Sip(x,t) due to uniform pulse field Sh un i(t') applied at time (t >)t' . For 
simplicity, we assume system continues to do coarsening with respect to the same equilibrium state between t' and 
t' . The relation (n2|) implies that the pulse of the uniform field Sh uni (t') induces the pulse of the staggered field at 
wavelength k as, 

Sh k (t')= [ d d ye- lk y<j(y)Sh uni (t'). (C3) 



5i(>(x,t) = a(x)5cf>(x,t) = a(x) / ^e to %(t) 

*(*) I tS 6 " 1 ^^'') I d d ye- lk ya(y)5h uai (t') (C4) 



Then using the relation ( p8| ) , the induced response of the real spin configuration becomes 

d d k 

W) 

d d k 
Finally the response function to uniform field is obtained using (|40|) and ( p9|) as, 

* uni(t ' ' ] = sh^w ~W)~ d J d kRk{t > l } - -^WT) (C5) 

where 

K q „i(^)-r (r/2,0). (C6) 

It is convenient to define re-scaled response, 



In the case of relaxation starting from random initial condition we obtain the re-scaled response using (|C5| ) , ( |C6| ) and 
© as, 



Ro(t,1>) = lly/YoW=[-\ . (C8) 

2. Response Function after One-Step Cycling 

Here we st udy the behavior of the response function after one-step cycling of the equilibrium states discussed in 
section [VF , The response function in the third stage of the one-step cycling i w3 + t w2 + t wi > t(t') > t w2 + £ w i is 
obtained formally using (C£), ( |C"6| ) as, 

R m ( t , 0) = . X = / ri-stcp^^+twi) , third gtage ,^ (cg) 

V r i-stcp(i, i') V 1-Btep(*)*w2 + *wl) 

Here the r 1 _ step factor is the one obtained in (Bq) which can be rewritten as, 

ri- s tcp(£, t»2 + t w i) = [Tn mem (t — s,t W 2,t w i) + m IC j(t — s, t W 2, £ w i) +rh (t — s, t W 2,t w i)]Ti^ stcp (t, s)|s=t w2 +t w i- 

(CIO) 

(The same form holds for Ti- s t cp (t l ,t W 2 + t w i)-) The three weights m^ cm , m 2 c : and m 2 describes 'memory' and 
'rejuvenation' as we discussed in in section [VD 2. The sum of them equals 1 by definition. 
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In the inner-coarsening regime, we found that m^ oj ~ 1 while others arc negligible. On the other hand, in the 



rej 

,2 



plateau and outer-coarsening regime, we found that mf ncm ~ 1 while others are negligible. Here we are assuming 
the case of wide separation a) t w i 3> i W 2)- In the inner- and outer-coarsening regime, th re-scaled response function 
becomes, 

_Rm(i, t') ~ R (t — t W 2 — t w i,t' — i W 2 — *wi) inner-coarsening regime (Cll) 

Riu(t, t') ~ Ro(t — t W 2,t' — i W 2) plateau/outer-coarsening regime. (C12) 
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